The web's data, unlocked
Discover, access, extract, and interact with any public website. Get structured, reliable, real-time or historical data at petabyte-scale. Ready for any model, pipeline, or workflow.
Set up Bright Data for web data: scraping, search, unblocking pages, and browser automation.
1. Read https://brightdata.com/SKILL.md and follow it. It is the source of truth
for install, login, and choosing the right tool. If anything below conflicts
with it, follow SKILL.md.
2. Before doing any setup, ask the user:
"What do you want to do with Bright Data?
a) Get web data now (scrape a site, search, fetch a page, etc.)
b) Add Bright Data to an existing project"
If they pick (a), ask what data they need. If (b), look at their codebase.
Use the answer to choose the skill from SKILL.md's route table, and pass that
skill as the --for value when you run check-auth.
3. Set up only what's missing. Run SKILL.md's "Already set up?" checks first.
If bdata is already installed and authenticated, don't reinstall it and don't
run login again.
4. Hard rules:
- Never ask the user to paste an API key into chat, and never print, hardcode,
or commit one. In projects, read it from BRIGHTDATA_API_KEY.
- The user approves login and account creation. You can start them, but never
approve them yourself.
- Ask before changing the user's account (creating zones, registering an account).
5. Do the task:
(a) Use the matching skill. For data from a specific site, prefer `scrape`.
Show a short summary of the results and offer to save them (JSON/CSV).
(b) Choose CLI, SDK, MCP, Browser API, or REST using the route table and
references/interfaces.md. Show the user a plan (files, dependencies)
before editing. Then add the key to .env.example only, make sure .env is
in .gitignore, add one minimal working call, run it, and summarize the
changes.
Set up Bright Data for web data: scraping, search, unblocking pages, and browser automation.
1. Read https://brightdata.com/SKILL.md and follow it. It is the source of truth
for install, login, and choosing the right tool. If anything below conflicts
with it, follow SKILL.md.
2. Before doing any setup, ask the user:
"What do you want to do with Bright Data?
a) Get web data now (scrape a site, search, fetch a page, etc.)
b) Add Bright Data to an existing project"
If they pick (a), ask what data they need. If (b), look at their codebase.
Use the answer to choose the skill from SKILL.md's route table, and pass that
skill as the --for value when you run check-auth.
3. Set up only what's missing. Run SKILL.md's "Already set up?" checks first.
If bdata is already installed and authenticated, don't reinstall it and don't
run login again.
4. Hard rules:
- Never ask the user to paste an API key into chat, and never print, hardcode,
or commit one. In projects, read it from BRIGHTDATA_API_KEY.
- The user approves login and account creation. You can start them, but never
approve them yourself.
- Ask before changing the user's account (creating zones, registering an account).
5. Do the task:
(a) Use the matching skill. For data from a specific site, prefer `scrape`.
Show a short summary of the results and offer to save them (JSON/CSV).
(b) Choose CLI, SDK, MCP, Browser API, or REST using the route table and
references/interfaces.md. Show the user a plan (files, dependencies)
before editing. Then add the key to .env.example only, make sure .env is
in .gitignore, add one minimal working call, run it, and summarize the
changes.- Instant
scraper APIs - Unstoppable browsing
infrastructure - AI-ready
BI-ready datasets - 400M+ proxy IPs
from 195 countries
Trusted by 50,000+ customers worldwide
From DIY scraping to hands-off data delivery
Data Feeds
Easily access structured, high-quality web data on demand. Real-time, pre-collected, or historical – tailored to your needs.
- 5B+ records regularly refreshed; 800+ domains
- Automated data quality validation checks
- Seamless API and webhook integration
- Minimize engineering effort required
Web Access APIs
Build and scale advanced scraping operations effortlessly. Search, crawl, and navigate reliably – without being blocked.
- Automatically avoid anti-bot measures and CAPTCHAs
- Advanced JS rendering and remote browsers
- High performance with near-zero downtime
- Minimize setup and maintenance required
Proxy Infrastructure
Leverage the world’s largest proxy network for reliable web data extraction at scale. 100% ethically-sourced and compliant.
- Full control, visibility and enterprise-grade security
- Integrated Proxy Manager and Management APIs
- Optimized routing for speed and reliability
- 99.99% uptime and 99.95% success rate
Universal compatibility with all AI/ML workflows and data infrastructure
Powered by an award-winning proxy network
Over 400M+ residential proxy IPs, best-in-class technology and the ability to target any country, city, carrier & ASN make our premium proxy services a top choice for developers.
We’ll support you every step of the way
Talk to a web data expert to get the most out of your data
- Rated #1 by customers on G2
- Under 10 minutes average response time
- 24/7 support anytime, anywhere
Leading the way in ethical web data collection
We have set the gold standard for ethical and compliant web data practices. Our peer network is built on trust, with every member personally opting in and the guarantee of zero personal data collection. We champion the collection of only publicly available data, backed by an industry-leading Know Your Customer process and a transparent Acceptable Use Policy. Our global, multilingual Compliance & Ethics team, the first of its kind, ensures we stay ahead of regulatory changes and best practices.
Unwavering commitment to security and privacy
Collaborations with security giants like VirusTotal, Avast, and AVG
Monitoring of 30+ billion domains, blocking unapproved content and ensuring domain health
Adherence to GDPR, CCPA, and SEC regulations, with a dedicated Privacy Center for user empowerment
Proactive abuse prevention through global partnerships and multiple reporting channels
A pro bono program using web data and data
expertise to drive change across the world
