Scraping Browser API
Revolutionize your web scraping using browsers built with website unblocking automation

Website unblocking
Implement with a single line of code
const puppeteer = require('puppeteer-core');
const auth = 'USERNAME:PASSWORD';
async function run(){
let browser;
try {
browser = await puppeteer.connect({
browserWSEndpoint: `wss://${auth}@brd.superproxy.io:9222`,
});
const page = await browser.newPage();
page.setDefaultNavigationTimeout(2*60*1000);
await page.goto('http://lumtest.com/myip.json');
const html = await page.content();
console.log(html);
} catch(e){
console.error('run failed', e);
} finally {
await browser?.close();
}
}
if (require.main==module)
run();
import asyncio
from playwright.async_api import async_playwright
auth = 'USERNAME:PASSWORD'
browser_url = 'wss://{auth}@brd.superproxy.io:9222'
async def main():
async with async_playwright() as pw:
print('connecting');
browser = await pw.chromium.connect_over_cdp(browser_url)
print('connected');
page = await browser.new_page()
print('goto')
await page.goto('http://lumtest.com/myip.json', timeout=120000)
print('done, evaluating')
print(await page.evaluate('()=>document.documentElement.outerHTML'))
await browser.close()
asyncio.run(main())
3-in-1 website unblocking solution
Combines 3 solutions in one browser: proxy tech, automated unblocking & browser functions
Ideal for multi-step web scraping
Save time & resources for complex web scraping that require website interactions
Puppeteer, Playwright & Selenium compatible
Easily integrate Scraping Browser into your current scraping infrastructure
Scale with unlimited browsers at once
Save infrastructure costs & scale unlimited sessions, using a simple browser API
Scraping Browser in Action: A Comprehensive Product Walkthrough
Bypass tough blocks & effortlessly perform multi-step web scraping
Scraping Browser is ideal for multi-step scraping projects that require browser interactions along with automated proxy and website unblocking management. The 3-in-1 browser automatically manages CAPTCHA solving, browser fingerprinting, automatic retries, selecting headers, cookies, & Javascript rendering, and more, so you can save time and resources.
Save on infrastructure cost of hosting browsers & unblocking websites
Bright Data handles the site unblocking and browser hosting, saving you infrastructure and resource costs. You retain control over the scraping process by hosting scraper on your end, enabling adaptability and customization.
Scale with unlimited web scraping browsers, without the cloud costs
With Scraping Browser, you can grow your data scraping projects with as many browsers as you need. Browsers are hosted on Bright Data’s highly-scalable infrastructure, saving you the expensive cost of cloud-based hosting, storage, & infrastructure
Puppeteer, Playwright & Selenium Compatible
Easily make an API call to fetch any number of browser sessions and interact with them using Puppeteer (Python), Playwright (Node.js), or Selenium. Enjoy seamless integration with your existing scrapers. Ideal for scraping projects that need website interactions to retrieve data, like hovering over a page, clicking buttons, scrolling, adding text, etc.
Inspect and fine-tune your code with Scraping Browser’s Debugger
Debugging is vital for identifying and resolving issues related to data scraping, including intricate interactions with target websites. Scraping Browser includes a debugging feature, which integrates seamlessly with Chrome Dev Tools, allowing developers to inspect, analyze, and fine-tune their code, for better control, visibility, and efficiency.
Save time and resources with an all-in-one scraping tool.
Powered by an award-winning proxy network
Over 72 million IPs, best-in-class technology
and the ability to target any country, city, carrier & ASN make our premium proxy services a top choice for developers.
How Scraping Browser outperforms Headless Browsers
Scraping Browser vs Headless Browser
When selecting an automated browser, developers should be aware of the differences between a headless browser and a “headfull”/GUI browser. A headless browser is a web browser without a graphical user interface. While headless browsers are often used with proxies for data scraping, these browsers are easily detected by bot-protection software, making data scraping difficult on a large scale.
Scraping Browser is far superior to headless browsers for scaling data scraping projects & bypassing blocks
Automated Browser for website unlocking
Scraping Browser is a GUI browser (aka “headfull” browser) that uses a graphic user interface, and is controlled by Puppeteer or Playwright API. A GUI browser is less likely to be picked up by bot detection software. Scraping Browser also has built-in website unlocking functions that handle blocks for you automatically. Because Scraping Browsers are opened on Bright Data’s servers, these automated browsers are ideal for scaling web data scraping projects, as you can open as many Scraping Browsers as you need without an expansive in-house infrastructure.
How to get started
STEP 1
Sign up for Bright Data and add a Scraping Browser zone to your personalized dashboard
STEP 2
Get your credentials, check documentation and code examples
STEP 3
Connect your scraper to the Scraping Browser
We’ll support you every step of the way
Talk to a web data expert to get the most out of your data
- Rated #1 by customers on G2
- Under 10 minutes average response time
- 24/7 support anytime, anywhere
Flexible pricing, starting from $13.50/GB
7 Day Free Trial
- Pay as you go and custom plans available
- 24/7 billing live support
- Save up to 50% with long-term pricing plans
Speak to our sales team about the 50% discount after your free trial
A pro bono program using web data and data
expertise to drive change across the world
Organizations
Institutions
Organizations
135+ NGOs
Public Sector Bodies
Scraping Browser FAQ
Scraping Browser works like other automated browsers and is controlled by common high-level APIs like Puppeteer and Playwright, but is the only browser with built-in website unblocking capabilities. Scraping Browser automatically manages all website unlocking operations under the hood, including: CAPTCHA solving, browser fingerprinting, automatic retries, selecting headers, cookies, & Javascript rendering, and more, so you can save time and resources.
When data scraping, developers use automated browsers when JavaScript rendering of a page or interactions with a website are needed (hovering, changing pages, clicking, screenshots, etc.). In addition, browsers are useful for large-scaling data scraping projects when multiple pages are targeted at once.
Scraping Browser is a GUI browser (aka “headfull” browser) that uses a graphic user interface. However, a developer will experience Scraping Browser as headless, interacting with the browser through an API like Puppeteer or Playwright. Scraping Browser, however, is opened as a GUI Browser on Bright Data’s infrastructure.