Real-Time Data APIsfor Every Business Need
Access structured, filtered, and real-time data from 120+ domains via powerful APIs. Filter datasets with AI, automate data delivery, and integrate seamlessly into your workflows.
- AI-powered filtering with natural language
- Real-time data delivery via API
- Pay only for the data you need
- Ready-to-use code examples in 7+ languages
Trusted by 20,000+ customers worldwide
Filter massive datasets with a single prompt
Describe exactly what you need in plain English, and let AI apply the perfect filters automatically. Cut costs by retrieving only relevant data.
- Natural language filtering - no coding required
- AI applies accurate filters automatically
- Narrow billions of records to what matters
- Filter by any field: location, industry, job title, date
- Export filtered data in JSON, CSV, or Parquet
Real-Time Data APIs for Every Industry
Access structured, validated data from 120+ domains via powerful filter APIs. Get only the data you need, delivered in real-time to your application.
- 120+ domains
- 190+ dataset APIs
- Billions of records
LinkedIn people profiles
Amazon products
LinkedIn company information
Instagram - Profiles
Crunchbase companies information
Linkedin job listings information
Instagram - Posts
Google Maps full information
Zillow properties listing information
LinkedIn posts
X (formerly Twitter) - Posts
TikTok - Profiles
Youtube - Videos posts
Amazon Reviews
Facebook - Pages Posts by Profile URL
TikTok - Posts
Indeed job listings information
Companies information enriched dataset
Shopee - products
Walmart - products
Employees business enriched dataset
TikTok Shop
YouTube - Channels
Glassdoor companies overview information
Reddit- Posts
Google maps reviews
Airbnb Properties Information
Instagram - Reels
X (formerly Twitter) - Profiles
IMDB media
Booking Hotel Listings
Glassdoor companies reviews
Yahoo Finance business information
LinkedIn profiles Jobs Listings
Shein- Products
Instagram - Comments
Yelp businesses overview
pitchbook companies information
Facebook - Comments
Zoominfo companies information
Glassdoor job listings information
Amazon sellers info
eBay
Google Shopping
Github repository
Amazon products global dataset
Home Depot US
Facebook - Posts by group URL
G2 software product overview
Otodom Poland
Facebook Marketplace
Facebook - Posts by post URL
Etsy
Amazon best seller products
Australia real estate properties
Google Play Store
Trustpilot business reviews
TikTok - Comments
G2 software - product reviews
Amazon products search
Booking Listings Search
Goodreads books
Reddit - Comments
Facebook - Profiles
Yelp businesses reviews
Youtube - Comments
World population
Zillow price history
Target
Amazon Walmart
Facebook - Pages and Profiles
Zara - Products
Wikipedia articles
Pinterest - Posts
Indeed companies info
Best Buy products
Zoopla properties listing information
Lazada - Products
Lowes.com
NBA players' stats
Facebook Events
Ikea - Products
Walmart sellers info
OLX Brazil - marketplace ads
Sephora products
Realtor international properties listings
Ozon.ru products
Xing social network
Wayfair products
Facebook - Reels by profile URL
Google Shopping products search US
Creative Commons Images
Naver products
Digikey - Products
Google Play Store reviews
Facebook Company Reviews
Manta businesses
Owler companies information
US lawyers directory
Myntra products
Webmotors Brasil - Cars Listings
Mouser - Products
H&M - Products
Agoda Properties Listings
Apple App Store reviews
Tokopedia Products
mercadolivre.com.br products
Zonaprop Argentina - Properties Listing
Wildberries.ru products
VentureRadar company information
Quora posts
Carsales Cars Listings search page information
Pinterest - Profiles
Chileautos Chile - Cars Listings
Zalando products
Inmuebles24 Mexico - Properties Listings
Yapo Chile - marketplace ads
Asos - Products
Trustradius product reviews
Hermes- Products
World zipcodes
Costco products
Vimeo - Videos posts
Lazada - Reviews
Bluesky - Posts
Lego - Products
Aliexpress products
Kroger.com
Home Depot CA
Metrocuadrado - Properties Listings
Alibaba
Chanel Products
Lazada products search (GMV)
Dior - Products
Snapchat posts
Toctoc - Properties Listings
Infocasas Uruguay - Properties Listings
Properati Argentina and Colombia - Properties Listings
Ashleyfurniture - Products
Top 500 Bluesky Profiles
Fanatics.com - Products
Macys.com
Sephora Products
Crateandbarrel - Products
Mango Products
AE.com - Complete Products
Mediamarkt.de products
apple shop products
Apple App Store
Creative Commons 3D Models
Westelm products
Balenciaga.com - Products
chewy products
Autozone - products
Coupang products
Rona.ca products
Toysrus - Products
Loewe.com - Products
Sally Beauty Products
Carters.com - Products
Grainger
Zara Home Products
llbean.com - Products
Prada.com - Products
Instacart Products unified schema
adidas products
Fendi Products
Hoka products
Dick’s Sporting Goods
Nike products
Nordstrom
Massimo Dutti - Products
Micro Center Products
LLBean
Ulta
Delvaux - Products
Ysl.com - Products
Bottegaveneta.com - Products
Lululemon products
Mattressfirm - Products
Mybobs.com - Products
Raymourflanigan.com - Products
Barnes & Noble Products
Harbor Freight Products
Free people
Threads - Profiles
Advance Auto Parts
Rei
Sleepnumber.com - Products
Mercari Products
Dell Products
Flipkart Products unified schema
Overstock Products unified schema
Montblanc - Products
B&H Products
Samsung
Neiman Marcus
OLD NAVY Products
Celine.com - Products
Berluti.com - Products
Quince Products
American Eagle
Samsclub products
Williams sonoma products
La-z-boy.com - Products
hp products
Bath & Body Works
OUAI Products
Moynat.com - Products
Bass Pro Shops
Garmin Products
Sweetwater
iherb products
Sears Products
Anthropologie Products
ACE products
Kohl's Products unified schema
Poshmark Products unified schema
Tatcha Products
Rona.ca products unified schema
Ferguson Home Products
Vevor Products
Guitar Center Products
Staples
GNC Products
Newegg Products
Crateandbarrel - Products
Zoro Products
Victoria's Secret products
Macys Products unified schema
Saks Fifth Avenue products
Fragrance Net Products
Office Depot Products
Summit Racing Products
Lenovo Products
Dior Products Unified Schema
Bed Bath & Beyond
H&M products
ON Products
Pottery barn products
Parts Geek
Abercrombie & Fitch
GameStop Products
academy products
Napa Online
Zales
Underarmour Products
Patagonia Products
Clothing Shop Online Products
Vinted - Global
vitamin shoppe products
Urban Outfitters
Stradivarius Products
Newbalance products
Sony Electronics Products
J.Crew Products
Walgreens
Theordinary products
AT&T Products
Paula's Choice Products
Athome products
Backcountry products
Editorialist products
tractor supply products
thorne products
Markandgraham products
Bershka Products
Flooranddecor Products
World Market products
Vitacost products
Bloomingdale's
Cabelas products
Massimodutti
Zara.com products
Zara Home products
Terrain Products
Dollar General Products
Oxo Products
Cuisinart Products
Belk products
Hobbylobby
Pottery Barn Teen
Adorama
Sharkninja
Michaels Products
LA Roche Posay Products
Bjs Products
Soma Products
Nectar Sleep Products
CARiD Products
Eriks Bike Shop Products
scheels products
Containerstore products
Greenrow
Lyst
Rocksbox
Peoples Jewellers products
Kiehl's Products
Ring Products
Adafruit Products
Boohoo Products
Sigma Aldrich Products
L'oreal Paris Products
Pull & Bear Products
Pet Smart Products
Oysho
Pottery Barn Kids products
LG Products
Clinique Products
Nature Made Products
Blick Art Products
Asics Products
Farfetch Products
Sprouts Products
Birkenstock Products
Dillard's
Nintendo products
Ashley Furniture
WebstaurantStore
Converse Products
Sur La Table Products
Famousfootwear Products
Naturium Products
The North Face Products
Banana Republic Products
Uniqlo Products
Saatva Products
Nespresso Products
Salomon Products
Skims Product
Elfcosmetics Product
Rejuvenation
Dermalogica Products
American Trucks Products
Robot Shop Products
Mens Wear House Products
Crutchfield Products
Gap Products
Supply House Products
JEGS Products
TradeInn Products
Farm and Fleet Products
Eddie Bauer Products
Burrow Product
Ecstuning Products
Journeys Products
Rev Zilla Products
Kitchen Aid Products
Evo Products
Sierra Products
Corsair Products
Provantage Products
1A Auto Products
Breville Products
Moen Products
Rocky Mountain ATV MC Products
PacSun Products
Canon USA products
Abe Books Products
Columbia Products
Living Spaces Products
Sun And Ski Products
Coach Products
Boot Barn Products
Helly Hansen Products
Tire Rack Products
JCPenney Products
Skechers Products
SanDisk Products
AllModern Products
Life Extension Products
DJI Products
DreamCloud Sleep Products
Logitech Products
West Marine Products
Bambu Lab Products
Rough Country Products
Cycle Gear Products
Athleta Products
AFW Products
Monoprice Products
Arcteryx Products
MSI Store Products
Chrono24 Products
Tires Easy Products
Kirklands Products
Camping World Products
Pandora Products
Throtl Products
PetCo products
Gear 4 Music Products
Fisher Scientific Products
Ann Taylor Products
Gap Factory Products
Newegg Business Products
Christianbook Products
Brother USA Products
Lights Daddy Products
Joss and Main Products
Pretty Little Thing Products
Graco Baby Products
VitalSource Products
Parts Express Products
Restaurant Supply Products
Sorel Products
Reebok Products
Brooks Brothers Products
Frigidaire Products
Trueclassictees Product
JBL Products
Zumiez Products
Jomashop Products
Brooks Running Products
The Company Store Products
Rogue Fitness Products
Levoit Products
Hanes Products
Verizon Products
Michael Kors Products
Gymshark Product
Hims Product
Vuoriclothing Product
Fentybeauty Product
Harrys Product
Allbirds Product
Data Feeds Pricing
- Clean and validated
- Refreshed monthly
- JSON/CSV/Parquet
Flexible delivery to fit your workflow
Receive filtered data via API response, Webhook, S3, Snowflake, Azure, or direct download
curl --request POST
--url https://api.brightdata.com/datasets/filter
--header 'Authorization: Bearer '
--header 'Content-Type: application/json'
--data '{
"dataset_id": "gd_l1viktl72bvl7bjuj0",
"records_limit": 100,
"filter": {
"name": "job_title",
"operator": "=",
"value": "Software Engineer"
}
}'
import requests
url = "https://api.brightdata.com/datasets/filter"
headers = {"Authorization": "Bearer "}
payload = {
"dataset_id": "gd_l1viktl72bvl7bjuj0",
"records_limit": 100,
"filter": {
"name": "job_title",
"operator": "=",
"value": "Software Engineer"
}
}
response = requests.post(url, json=payload, headers=headers)
print(response.json())
const url = 'https://api.brightdata.com/datasets/filter';
const options = {
method: 'POST',
headers: {
'Authorization': 'Bearer ',
'Content-Type': 'application/json'
},
body: JSON.stringify({
dataset_id: 'gd_l1viktl72bvl7bjuj0',
records_limit: 100,
filter: {
name: 'job_title',
operator: '=',
value: 'Software Engineer'
}
})
};
try {
const response = await fetch(url, options);
const data = await response.json();
console.log(data);
} catch (error) {
console.error(error);
}
HttpResponse response = Unirest.post("https://api.brightdata.com/datasets/filter")
.header("Authorization", "Bearer ")
.header("Content-Type", "application/json")
.body("{"dataset_id":"gd_l1viktl72bvl7bjuj0","records_limit":100,"filter":{"name":"job_title","operator":"=","value":"Software Engineer"}}")
.asString();
Filter and retrieve data with simple API calls
Why Data Feed APIs?
AI-Powered Filtering
Build precise filters with simple JSON operators. No complex scraping logic required.
Real-Time API Access
Retrieve filtered data directly to your application via RESTful API with instant response times.
Structured & Clean Data
Pre-validated, deduplicated data with consistent schemas, ready for immediate use in your applications.
Flexible Delivery Options
Download via API, Webhook, S3, Snowflake, or direct download in JSON, CSV, or Parquet formats.
Developer-Friendly
Complete API documentation with code examples in Python, Node.js, cURL, PHP, Go, Java, and Ruby.
Pay Only for What You Use
Filter billions of records down to exactly what you need. No paying for irrelevant data.
Maximize value with strategic cost savings
Pay Per Record
Only pay for the exact records you retrieve. Filter billions down to thousands—pay only for what you use.
Smart Data Updates
Subscribe to "New Records" or "Updated Records" only—avoid re-downloading unchanged data.
Volume Discounts
Scale your data access with significant savings on large volume requests and subscriptions.
API Efficiency
Retrieve pre-filtered data directly—no need to download and process massive files locally.
Discover how Data APIs can work for you
Power your sales pipeline with targeted data
Filter LinkedIn profiles by job title, company, location, and skills. Build precise prospect lists and automate lead scoring.
Stay ahead with real-time competitive insights
Monitor competitor pricing, track product launches, analyze reviews and sentiment across e-commerce and social platforms.
Feed your models with high-quality, structured data
Access millions of text, image, and structured data records to train AI models, power LLMs, and build intelligent applications.
Make data-driven investment decisions
Track company growth metrics, funding rounds, leadership changes, and market signals to identify investment opportunities.
Discover property opportunities with market data
Monitor listings, pricing trends, rental rates, and property features across multiple markets to identify opportunities.
Ready to power your business with data APIs?
Access 190+ real-time data APIs with AI-powered filtering and flexible delivery
Data Feed APIs FAQs
What are Data Feed APIs?
Data Feed APIs are RESTful APIs that allow you to filter datasets and create snapshots with only the data you need. The Filter Dataset API endpoint starts an asynchronous job that filters your selected dataset and creates a snapshot based on your criteria, which you can then download or access programmatically.
How does the filtering process work?
When you call the Filter Dataset API, it creates an asynchronous job that applies your filters and generates a snapshot. The process has a maximum timeout of 5 minutes. Once complete, you receive a snapshot_id that you can use to access your filtered data. You're only charged for the snapshot size based on the record price.
What filter operators can I use?
The API supports a wide range of operators: = (equal), != (not equal), < and > (less/greater than), <= and >= (less/greater or equal), 'in' and 'not_in' (value matching), 'includes' and 'not_includes' (substring/array contains), 'array_includes' and 'not_array_includes' (exact array matching), and 'is_null' / 'is_not_null' for checking empty values. Different operators apply to different field types (text, number, date, array).
Can I combine multiple filters?
Yes. You can combine multiple filters using 'and' or 'or' logical operators in filter groups. The API supports a maximum nesting depth of 3 levels. For arrays of objects, you can use the 'combine_nested_fields' parameter to ensure all filters match within a single object rather than across the entire array.
How do I filter with large lists of values?
The API supports two modes: JSON Mode for standard filtering, and Multipart/Form-Data Mode for uploading CSV or JSON files containing filter values. In Multipart mode, send dataset_id and records_limit as query parameters, then include your filter definition and files in the form-data body. This is ideal for filtering by hundreds or thousands of values.
What credentials do I need to use the API?
You only need two things: your dataset ID (found on the dataset's detail page) and your Bright Data API key. Include your API key as a Bearer token in the Authorization header. No proxy zones, passwords, or additional credentials are required for dataset filtering.
What data formats are supported?
Filtered snapshots are available in JSON, NDJSON, CSV, and Parquet formats. You can specify your preferred format when downloading the snapshot or configuring your delivery method.
How do I retrieve my filtered data?
After the API returns a snapshot_id, you can retrieve your filtered data via direct download, API response, Webhook callbacks, Amazon S3, Google Cloud Storage, Snowflake, Azure, SFTP, or email. Choose the delivery method that best fits your workflow.
What happens if my filter doesn't match any records?
The API will return a 422 error with the message 'Provided filter did not match any records.' Review your filter syntax and values to ensure they match data in the dataset. You can preview dataset fields and sample data in the Control Panel before filtering.
Are there limits on how many filter jobs I can run?
Yes. Each dataset has a maximum limit of 100 parallel jobs. If you exceed this limit, you'll receive a 429 error. Wait for existing jobs to complete before starting new ones, or contact sales for high-volume use cases requiring increased limits.
What if I don't have enough funds?
If your account balance is insufficient to process the filtered snapshot, you'll receive a 402 error indicating the amount needed. Add funds to your account or adjust your filter to reduce the number of records before trying again.
Where can I find code examples?
Complete code examples are available in the API documentation for cURL, Python, JavaScript, and Java. Each example shows how to authenticate, structure your filter request, and handle the response. You can also generate filter syntax directly from the Control Panel by applying filters in the UI and clicking 'Filter API.'
Start accessing real-time data today
Filter, retrieve, and integrate web data via powerful APIs