- Build requests in any language
- Automate with schedulers and webhooks
- JSON, NDJSON, or CSV delivery
Keep web data flowingwith Scraper APIs
Thousands of verified scrapers for every website. Never worry about scale, unblocking, or maintenance.
Trusted by 50,000+ customers worldwide
Web Scraper API Library
Explore thousands of production-ready scrapers
Pay only for successful results, no surprises – Proxies, unlocking, browsers and retries are built in.
Web Scraper API Pricing
Only pay for what’s successfully delivered. No hidden fees, no charges for failed deliveries.
- Pay only for success, no hidden fees
- Start free with 5,000 monthly credits
- No upfront commitment, cancel anytime
- 24/7 expert support and enterprise features
From zero to data in 3 steps
-
Pick a scraper
Choose from the [current_scraper_name} scrapers above or create your own with AI in minutes.
-
Call the API
One API call with up to 5,000 target URLs. Python and Node.js SDKs, CLI, MCP server, or any HTTP client.
-
Get structured data
Receive clean, parsed [current_scrper_name] data in JSON, NDJSON, or CSV. Delivered via API, webhook, or cloud storage.
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.amazon.com/Quencher-FlowState-Stainless-Insulated-Smoothie/dp/B0CRMZHDG8","asin":"B0CRMZHDG8","origin_url":"https://www.amazon.com/Quencher-FlowState-Stainless-Insulated-Smoothie/dp/B0CRMZHDG8","zipcode":"94107","language":""},{"url":"https://www.amazon.com/KitchenAid-Protective-Dishwasher-Stainless-8-72-Inch/dp/B07PZF3QS3","asin":"B07PZF3QS3","zipcode":"","language":""},{"url":"https://www.amazon.com/TruSkin-Naturals-Vitamin-Topical-Hyaluronic/dp/B01M4MCUAF","asin":"","origin_url":"https://www.amazon.com/TruSkin-Naturals-Vitamin-Topical-Hyaluronic/dp/B01M4MCUAF","zipcode":"94124","language":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_l7q7dkf244hwjntr0&format=json&uncompressed_webhook=true"
[
{
"timestamp": "2026-10-01",
"title": "LB Chick Breast Treat8",
"seller_name": null,
"brand": "Cadet",
"description": "Bag Quantity: Cadet 14 oz (8), Chicken Breast Dog Treats, Made with Premium Real Chicken, A Healthy, Natural Treat for D...",
"initial_price": null,
"currency": "USD",
"availability": null
},
{
"timestamp": "2026-10-01",
"title": "Cadet Icelandic Sheepdog Trainee Pilot T-Shirt",
"seller_name": "Ama***.co***",
"brand": "Icelandic Sheepdogs Owner Gift",
"description": "Show This Cadet Icelandic Sheepdog Trainee Pilot Item While Walking Our Four Legged Friends. If You Are A Crazy Dog Love...",
"initial_price": 21.98,
"currency": "USD",
"availability": "In Stock"
},
{
"timestamp": "2026-10-01",
"title": "Cadet Bulldog Trainee Pilot Pocket T-Shirt",
"seller_name": "Ama***.co***",
"brand": "Bulldogs Owner Gift",
"description": "Show This Cadet Bulldog Trainee Pilot Pocket Item While Walking Our Four Legged Friends. If You Are A Crazy Dog Lover Th...",
"initial_price": 21.98,
"currency": "USD",
"availability": "In Stock"
},
{
"timestamp": "2026-10-01",
"title": "16700-Z6L-003 Fuel Pump 16700Z6L003 520-012 Compatible with Honda GX630 GX660 GX690 GXV630 GXV690 Cub Cadet RZT-L42 Big ...",
"seller_name": "Tex***rts***",
"brand": "Texxparts",
"description": "About this item Part Number: Compatible with Honda 16700-Z6L-003 16700Z6L003; 520-012 16700-Z6L-003 Fuel Pump Compatible...",
"initial_price": 18.99,
"currency": "USD",
"availability": "In Stock"
},
{
"timestamp": "2026-10-01",
"title": "Cadet Greater Swiss Mountain Dog Trainee Pilot T-Shirt for Men Women Kids",
"seller_name": "Ama***.co***",
"brand": "Greater Swiss Mountain Dogs Owner Gift",
"description": "Show This Cadet Greater Swiss Mountain Dog Trainee Pilot Item While Walking Our Four Legged Friends. If You Are A Crazy ...",
"initial_price": 21.98,
"currency": "USD",
"availability": "In Stock"
}
]
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.walmart.com/ip/Hershey-s-Kit-Kat-And-Reese-s-Assorted-Flavored-Candy-Party-Pack-33-38-oz/466623588?athbdg=L1600\u0026adsRedirect=true","zipcode":""},{"url":"https://www.walmart.com/ip/Starburst-Pink-Yellow-Mix-Chewy-Fruit-Candy-3-lbs-Original-Strawberry-Lemon-Soft-Chew-Candies-Bulk-Family-Size-Assortment-Pack-Individually-Wrapped-4/1016450755?adsRedirect=true","zipcode":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_l95fol7l1ru6rlo116&format=json&uncompressed_webhook=true"
[
{
"timestamp": "2026-09-30",
"url": "https:\/\/www.walmart.com\/ip\/Rayovac-Mercury-Free-Proline-Advanced-Size-10-Hearing-Aid-Batteries-Total-of-48-Batteries\/187...",
"final_price": 26.97,
"sku": "187173525",
"currency": "USD",
"gtin": "689978361964",
"specifications": [
{
"name": "Battery size",
"value": "10"
},
{
"name": "Brand",
"value": "Rayovac"
},
{
"name": "Features",
"value": "Zinc Air"
},
{
"name": "Ingredient preference",
"value": "Mercury-Free"
},
{
"name": "Batteries",
"value": "48"
},
{
"name": "Model",
"value": "Mercury Free 10-A"
},
{
"name": "Product multifunction descriptor",
"value": "Active Core Plus with New Air Optimization Technology"
},
{
"name": "Count ",
"value": "48"
}
],
"image_urls": [
"https:\/\/i5.walmartimages.com\/seo\/Rayovac-Mercury-Free-Proline-Advanced-Size-10-Hearing-Aid-Batteries-Total-of-48-Batteri...",
"https:\/\/i5.walmartimages.com\/asr\/ab1752e8-8873-48df-9912-c7e66fe6f5b3_1.b3819871b839678fce48ee423adefa3c.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/680435a2-131b-472a-abcb-af3efb759a12_1.23241173771974c1eae0efab0ee9a635.jpeg"
]
},
{
"timestamp": "2026-09-30",
"url": "https:\/\/www.walmart.com\/ip\/Men-s-Hocus-Pocus-2-Billy-Zombie-Lose-Your-Head-Long-Sleeve-Shirt-Black-Large\/5208383093",
"final_price": 14.99,
"sku": "5208383093",
"currency": "USD",
"gtin": "197419372399",
"specifications": [
{
"name": "Color",
"value": "Black"
},
{
"name": "Gender",
"value": "Male"
},
{
"name": "Brand",
"value": "Hocus Pocus 2"
},
{
"name": "Clothing fit",
"value": "Classic Fit"
},
{
"name": "Clothing neck style",
"value": "Crew Neck"
},
{
"name": "Sleeve length style",
"value": "Long Sleeve"
},
{
"name": "Pattern",
"value": "Graphic Prints"
},
{
"name": "Fabric material name",
"value": "Cotton"
}
],
"image_urls": [
"https:\/\/i5.walmartimages.com\/seo\/Men-s-Hocus-Pocus-2-Billy-Zombie-Lose-Your-Head-Long-Sleeve-Shirt-Black-Large_504e12b8-...",
"https:\/\/i5.walmartimages.com\/asr\/80ad8140-f237-4fd3-8976-bf8de0e9c56d.9f036ed9e22b485628f945a2d26b1ae3.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/399c882d-c6a6-4d8a-96ce-81d2e553ed31.6e74288ab8f7f7590ec58269fef4bf3d.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/a8cab173-3af0-4b65-992b-e9aa903c65ee.d78f769577033ee34242005ae328f229.jpeg"
]
},
{
"timestamp": "2026-09-30",
"url": "https:\/\/www.walmart.com\/ip\/Metal-Ice-Scoop-9-8-x-3-5-Stainless-Steel-Ice-Scooper-for-Home-Bar-Use-Silver\/15858265708",
"final_price": 15.99,
"sku": "15858265708",
"currency": "USD",
"gtin": "679679816535",
"specifications": [
{
"name": "Kitchen scoop type",
"value": "Kitchen Scoop"
},
{
"name": "Head material",
"value": "Stainless Steel"
},
{
"name": "Handle material",
"value": "Stainless Steel"
},
{
"name": "Color",
"value": "Silver"
},
{
"name": "Brand",
"value": "Uxcell"
},
{
"name": "Features",
"value": "Rust Resistant"
},
{
"name": "Pieces",
"value": "4"
},
{
"name": "Items included",
"value": "1pcs x ice cream scoop"
}
],
"image_urls": [
"https:\/\/i5.walmartimages.com\/seo\/Metal-Ice-Scoop-9-8-x-3-5-Stainless-Steel-Ice-Scooper-for-Home-Bar-Use-Silver_eba43093-...",
"https:\/\/i5.walmartimages.com\/asr\/bbb28e1b-77d3-4a3c-8049-c844c0507849.cbb676868cfaf20d746c26e3bea590cf.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/ba74af7b-d9d3-48d9-a1e2-57ea25b13598.e3a56a64c6004e2bdf46f0f3ff130d48.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/6d7195ff-702d-4c3b-8720-0fbfc7625910.93930443a6ab46a435a1b2e6fb1eb643.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/202d7284-7f7c-443d-a29c-df385677d457.3600b05654d2e7797c128e2af48bd9d1.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/4a2e8940-1e6d-4e40-b371-d2f6eb3d01e8.a6e6c4366242ec463fc0486fd317bc16.jpeg"
]
},
{
"timestamp": "2026-09-30",
"url": "https:\/\/www.walmart.com\/ip\/TaTaai-Women-s-Lightweight-Sleep-Dress-with-All-Over-Print-Front-Zipper-Short-Sleeves-and-Com...",
"final_price": 10.67,
"sku": "6P2F0O847D0O",
"currency": "USD",
"gtin": null,
"specifications": [
{
"name": "Clothing size",
"value": "L"
},
{
"name": "Sleeve length style",
"value": "Long Sleeve"
},
{
"name": "Color",
"value": "Multicolor"
},
{
"name": "Brand",
"value": "TaTaai"
},
{
"name": "Clothing length style",
"value": "Casual"
},
{
"name": "Fabric content",
"value": "99% Polyester,Spandex"
},
{
"name": "Clothing fit",
"value": "Relaxed Fit"
},
{
"name": "Pattern",
"value": "Printed"
}
],
"image_urls": [
"https:\/\/i5.walmartimages.com\/seo\/TaTaai-Women-s-Lightweight-Sleep-Dress-with-All-Over-Print-Front-Zipper-Short-Sleeves-a...",
"https:\/\/i5.walmartimages.com\/asr\/bc537b90-7e08-4f1d-8271-62b7d5f6c1ea.8a072b95d61c53a40d19ba9198f511aa.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/413c4d01-45ae-4cb7-8478-7e2224b17aef.9515887c6bbcc4e5271614f4d671a166.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/df2e95bd-24bc-4a00-8a2d-c926cd1d4f37.aac09d34fab892a449c67a63234bc58c.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/8c88f69f-40f1-43da-a0be-9ba4cf9d0d87.842b5ac39512b559a56b4174ca990047.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/45d25a95-f136-4a9c-94b1-48ad6431c62c.dc3ae06e952e2e7bd6921e9f670a0b5f.jpeg"
]
},
{
"timestamp": "2026-09-30",
"url": "https:\/\/www.walmart.com\/ip\/Blackout-Curtains-for-Girls-Kids-Bedroom-Colorful-Double-Layer-Star-Cut-Out-Curtains-for-Girl...",
"final_price": 32.99,
"sku": "17774065271",
"currency": "USD",
"gtin": null,
"specifications": [
{
"name": "Curtain length",
"value": "84 in"
},
{
"name": "Color",
"value": "Pink"
},
{
"name": "Window treatment sheerness",
"value": "Blackout"
},
{
"name": "Curtain panel style",
"value": "Draped"
},
{
"name": "Curtain width",
"value": "52 in"
},
{
"name": "Curtain \u0026 valance type",
"value": "Single Curtain Panels"
},
{
"name": "Material",
"value": "Polyester"
},
{
"name": "Pattern",
"value": "2 Panels"
}
],
"image_urls": [
"https:\/\/i5.walmartimages.com\/seo\/Blackout-Curtains-for-Girls-Kids-Bedroom-Colorful-Double-Layer-Star-Cut-Out-Curtains-fo...",
"https:\/\/i5.walmartimages.com\/asr\/2fb7d0b6-d166-4796-8a1a-581ede61d778.6dc3061494d004832a2c01ea5d0526c1.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/3fc02e8e-1635-45d9-8f87-3e15c232daf5.400d08005a71cecd64b7a2bd430b9151.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/34169ac7-f712-48bc-baa5-b64b15e12157.d9c0c3a0121318c85a12a0f1b89c8299.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/e2040106-f40f-44ad-a6ee-b2cd1260455b.b0584a6833fe45ec646eb068488def35.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/afdca9b2-ed38-4497-ac29-bdf3b2b08f2d.3382b87593bc3edf4a01b9b200ed4143.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/369ff9f2-48f1-4b14-8225-4776f3608252.6e93586afb8e7db368897f8612c75db1.jpeg",
"https:\/\/i5.walmartimages.com\/asr\/4f92b8af-9ad3-4264-b76b-85f8d61b3aeb.68553a62c0729bceb43c78bd56dcf67f.jpeg"
]
}
]
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://www.target.com/p/petal-and-pup-skarlett-top/-/A-1002219928","zipcode":"01011"},{"url":"https://www.target.com/p/petal-and-pup-skarlett-top/-/A-1002219928","zipcode":""},{"url":"https://www.target.com/p/women-s-long-sleeve-shrunken-rib-t-shirt-universal-thread/-/A-88552173?preselect=88471695#lnk=sametab","zipcode":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_ltppk5mx2lp0v1k0vo&format=json&uncompressed_webhook=true"
[
{
"timestamp": "2026-10-01",
"url": "https:\/\/www.target.com\/p\/coofandy-men-casual-knitted-sweaters-shawl-collar-dress-sweater-long-sleeve-v-neck-pullover-top...",
"product_id": "1011276407",
"title": "COOFANDY Men Casual Knitted Sweaters Shawl Collar Dress Sweater Long Sleeve V-Neck Pullover Tops Green M",
"product_description": null,
"rating": 0,
"reviews_count": 0,
"initial_price": 39.99
},
{
"timestamp": "2026-10-01",
"url": "https:\/\/www.target.com\/p\/mlb-hat-looped-detroit-tigers\/-\/A-94873825",
"product_id": "94873825",
"title": "MLB Hat Looped Detroit Tigers",
"product_description": null,
"rating": 0,
"reviews_count": 0,
"initial_price": 19.99
},
{
"timestamp": "2026-10-01",
"url": "https:\/\/www.target.com\/p\/epic-graffiti-modern-dance-iii-by-james-burghardt-canvas-wall-art\/-\/A-1014319925",
"product_id": "1014319925",
"title": "Epic Graffiti \u0027Modern Dance III\u0027 by James Burghardt, Canvas Wall Art, 12\u0022x18\u0022",
"product_description": "\u0022Modern Dance III\u0022 by James Burghardt. James Burghardt has been a creative force in artwork and graphic design for over ...",
"rating": 0,
"reviews_count": 0,
"initial_price": 59.99
},
{
"timestamp": "2026-10-01",
"url": "https:\/\/www.target.com\/p\/avery-labels-2-x-3-matte-gold-new-year-countdown-160\/-\/A-1014075796",
"product_id": "1014075796",
"title": "Avery® Labels, 2\u0022 x 3\u0022, Matte, Gold New Year Countdown, 160",
"product_description": "Add a seasonal touch to branding, products, or events with Avery® 2\u0022 x 3\u0022 Rectangle Labels featuring the Gold New Year M...",
"rating": 0,
"reviews_count": 0,
"initial_price": 32.1
},
{
"timestamp": "2026-10-01",
"url": "https:\/\/www.target.com\/p\/shires-curb-hooks-pairs-robust-steel-for-pelham-bits-and-curb-chains-one-size\/-\/A-1008936591",
"product_id": "1008936591",
"title": "Shires Curb Hooks (Pairs) - Robust Steel for Pelham Bits and Curb Chains - One Size",
"product_description": "Ensure flawless communication and unwavering bridle security with the Shires Steel Curb Hooks, the essential link for an...",
"rating": 0,
"reviews_count": 0,
"initial_price": 14.12
}
]
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=Shein&format=json&uncompressed_webhook=true"
[]
Everything you need, built in
Go straight to the source
Scale to millions of pages instantly
Scrapers auto-fix when sites change
Thousands of verified scrapers
Pay per result, nothing extra
Compliant and fully supported
Start collecting Web data in minutes
Leading the way in ethical web data collection
Only publicly available data. ISO 27001 certified, SOC 2 controls, GDPR & CCPA compliant. Every use case is reviewed by a dedicated Compliance & Ethics team, backed by a documented Know Your Customer process and Acceptable Use Policy.
Scraper APIs for every use case
Google scraping APIs
Business & B2B scraping APIs
LLMs scraping APIs
Web Scraper API vs other providers
Web Scraper API FAQs
What are Web Scraper APIs?
Web Scraper APIs is a cloud-based service that simplifies web data extraction, offering automated handling of IP rotation, CAPTCHA solving, and data parsing into structured formats. It enables efficient, scalable data collection, tailored for businesses needing to access valuable web data seamlessly.
Who can benefit from using Web Scraper APIs?
Data analysts, scientists, engineers, and developers seeking efficient methods to collect and analyze web data for AI, ML, big data applications, and more will find Web Scraper APIs particularly beneficial.
Why choose Web Scraper APIs over manual scraping methods?
Web Scraper APIs overcome the limitations of manual web scraping, such as dealing with website structure changes, encountering blocks and captchas, and the high costs associated with infrastructure maintenance. It offers an automated, scalable, and reliable solution for data extraction, significantly reducing operational costs and time.
What makes Bright Data’s Web Scraper APIs unique in the market?
The uniqueness of Web Scraper APIs lies in its specialized features like Bulk Request Handling, Data Discovery, and Automated Validation, backed by advanced technologies including Residential Proxies and JavaScript Rendering. These capabilities ensure broad access, uphold high data integrity, and enhance overall efficiency, distinguishing Scraper APIs in the competitive landscape.
How can I get started with Web Scraper APIs?
Getting started with Web Scraper APIs is straightforward via Bright Data’s control panel, which provides comprehensive documentation and a user-friendly dashboard for API key management and settings. This approach minimizes setup requirements, allowing immediate access to a platform that is highly scalable and reliable for web data extraction needs.
What specific use cases are Web Scraper APIs optimized for?
Web Scraper APIs support a range of development needs including competitive benchmarking, market trend analysis, dynamic pricing algorithms, sentiment extraction, and feeding data into machine learning pipelines. Essential for e-commerce, fintech, and social media analytics, these APIs empower developers to implement data-driven strategies effectively.
How does Web Scraper APIs manage large-scale data extraction tasks?
Featuring capabilities for high concurrency and batch processing, Web Scraper APIs excel in large-scale data extraction scenarios. This ensures developers can scale their scraping operations efficiently, accommodating massive volumes of requests with high throughput.
In which data formats can Web Scraper APIs provide extracted information?
Web Scraper APIs deliver extracted data in versatile formats including NDJSON and CSV, ensuring seamless integration with a wide array of analytics tools and data processing workflows, thus facilitating easy adoption in developer environments.
What websites can I scrape?
There are 1,400+ pre-built scrapers for popular sites including Amazon, LinkedIn, Instagram, TikTok, Google Maps, Zillow, and hundreds more. For any other website, use Scraper Studio to create a custom scraper with AI in minutes.
Is web scraping with Bright Data legal and compliant?
Yes. Bright Data collects only publicly available data, is ISO 27001 certified, maintains SOC 2 controls, and is GDPR and CCPA compliant. A dedicated Compliance & Ethics team reviews every use case, backed by a documented Know Your Customer process and Acceptable Use Policy. Details are published in the Bright Data Trust Center.
Can AI agents use the Web Scraper API?
Yes. Connect any agent through the hosted MCP server, point a coding agent at brightdata.com/SKILL.md to set itself up, or use the CLI. Agents authenticate once with browser OAuth and can run any of the 1,400+ scrapers or build new ones with Scraper Studio.
Can I use this Web Scraper API with Python or Node.js?
Yes. Official SDKs for Python (brightdata-sdk) and Node.js (@brightdata/sdk) handle auth and result polling for you. You can also call the REST API from any HTTP client: requests, axios, cURL, Go, or Java. Every scraper page includes ready-made snippets in both languages.