Online Price Discrimination Is A Sad Reality, And Here’s How To End It

What is price discrimination and how a business can use residential proxy to get real prices
graphic showing person seeing different prices at different global locations
Bright Data marketing team

You hear from a friend about a flight ticket priced at $200; you quickly visit the retailer’s website and find the same ticket at $235. How is that possible? A study published in 2015 by Northeastern University reveals that more than 50% of the major online retailers are charging customers personalized prices based on their online profiles.

While retailers call this “personalization,” researchers and customers commonly refer to it as price discrimination. If based on the customer’s nationality or country of residence, this discrimination is illegal in the European Union.

The practice benefits from online databases that collect shoppers’ profiles. By using personal details and behavior, retailers can offer different prices to different users. Information used includes location and shopping history and is retained through user IPs and cookies.

In most countries, price personalization is illegal when based on a systematic pattern of discrimination towards specific demographics. Major companies in the EU have already been probed when suspected of overcharging customers from certain countries. Carried through a random selection system, however, it is not considered to be a criminal offense.

Though it’s hard to understand the algorithm of such discrimination, it has been widely acknowledged that this strategy is part of online retail’s current reality. “Many companies already use big data for targeted marketing, and some are experimenting with personalized pricing,” declared the White House in a report published last year.

Several hi-tech companies have started fighting this trend to democratize the online shopping experience. The aim of these “anti-discrimination” services is to give the original price to all users, no matter of their location or shopping history; so they rely on proxy networks to access the websites of the retailers in total anonymity. But is it really working? The answer depends on which proxy they use.

Anti-discrimination services can access retailers’ sites through a traditional proxy network, which operates through IPs located in data centers, and gain anonymity to attain the untouched price of an item. However, due to the use of data centers, these networks are relatively easy to identify. Therefore, we still cannot be sure that the price has not been modified. In other words, traditional proxy networks are not exempt from the risk of price discrimination.

The ideal way to unmask discrimination would be to appear exactly like a real customer who is checking prices. Thus, anti-discrimination services should be checking prices through actual residential computers (IPs). The Bright Data network is a global peer-to-peer proxy network and is helping anti-discrimination companies get the real pricing information from these online commerce websites by providing access from residential IPs. Through Bright Data, these companies can route their requests through millions of residential IPs on the Bright Data network, and ultimately get the untouched prices.

In just a few clicks, the online retail market may be “democratic” again, offering every shopper the same deals and prices.

Bright Data marketing team

You might also be interested in

What is data aggregation

Data Aggregation – Definition, Use Cases, and Challenges

This blog post will teach you everything you need to know about data aggregation. Here, you will see what data aggregation is, where it is used, what benefits it can bring, and what obstacles it involves.
What is a data parser featured image

What Is Data Parsing? Definition, Benefits, and Challenges

In this article, you will learn everything you need to know about data parsing. In detail, you will learn what data parsing is, why it is so important, and what is the best way to approach it.
What is a web crawler featured image

What is a Web Crawler?

Web crawlers are a critical part of the infrastructure of the Internet. In this article, we will discuss: Web Crawler Definition A web crawler is a software robot that scans the internet and downloads the data it finds. Most web crawlers are operated by search engines like Google, Bing, Baidu, and DuckDuckGo. Search engines apply […]

A Hands-On Guide to Web Scraping in R

In this tutorial, we’ll go through all the steps involved in web scraping in R with rvest with the goal of extracting product reviews from one publicly accessible URL from Amazon’s website.

The Ultimate Web Scraping With C# Guide

In this tutorial, you will learn how to build a web scraper in C#. In detail, you will see how to perform an HTTP request to download the web page you want to scrape, select HTML elements from its DOM tree, and extract data from them.
Javascript and node.js web scraping guide image

Web Scraping With JavaScript and Node.JS

We will cover why frontend JavaScript isn’t the best option for web scraping and will teach you how to build a Node.js scraper from scratch.
Web scraping with JSoup

Web Scraping in Java With Jsoup: A Step-By-Step Guide

Learn to perform web scraping with Jsoup in Java to automatically extract all data from an entire website.
Static vs. Rotating Proxies

Static vs Rotating Proxies: Detailed Comparison

Proxies play an important role in enabling businesses to conduct critical web research.