Fetch API

Turn any public URL into Markdown, plain text, raw HTML and JSON-LD with one API call. Bright Data handles proxies, CAPTCHAs and blocking, so you get page content ready for your LLM or parser.

5K free records/month · Credit card not required
How it works

From URL to clean data in 3 steps

No proxies to configure, no infrastructure to manage. Connect, send a URL, and read the page.
  1. Pass your URLs

    Provide the public URLs you want to fetch.

  2. Call the API

    One API call with up to 5,000 target URLs. Python and Node.js SDKs, CLI, MCP server, or any HTTP client.

  3. Get the page back

    Receive the page as clean Markdown, raw HTML, or JSON, with blocks, CAPTCHAs, and retries handled for you.

Pricing

Fetch API Pricing

Only pay for what’s successfully delivered. No hidden fees, no charges for failed deliveries.

CALCULATE YOUR COST
Records per month: 5K
$/mo
$ per 1,000 records
Your whole bill. Proxies, unblocking, parsing included.
Get started
5K
10K
50K
100K
500K
1M
5M
  • Pay only for success, no hidden fees
  • Start free with 5,000 monthly credits
  • No upfront commitment, cancel anytime
  • 24/7 expert support and enterprise features
Free Tier
5K
records
Start free
  • 5K records per month
  • No credit card required
  • Expert support
Pay as you go
$1.5/1K record
Start free
  • Pay only for success
  • Set monthly spend limits
  • Unlimited concurrency
  • Expert support
Scale
$499 /month
Start free
  • 384,000 records included
  • $1.3/1K additional records
  • Unlimited concurrency
  • Cancel anytime
  • Expert support
Enterprise
Custom
Talk to sales
  • Volume discounts
  • Account manager
  • Premium SLA
  • Priority support
  • SSO
Compute / runtime units
commonly billed per scraper runtime hour or compute unit
Included
Residential proxy bandwidth
commonly billed per GB
Included
Storage & dataset retention
commonly billed per GB-month
Included
Data transfer / egress
commonly billed per GB out
Included
Unblocking & CAPTCHA solving
commonly a paid add-on
Included
Parsing to structured JSON
commonly your own code
Included
We accept these payment methods:
Scraper API Call
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://example.com"},{"url":"https://example.com/1"}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_m6gjtfmeh43we6cqc&format=json&uncompressed_webhook=true"
Response payload
[
  {
    "timestamp": "2025-02-24",
    "markdown": null,
    "url": "https:\/\/www.mindat.org\/loc-419686.html",
    "final_url": null,
    "html2text": null,
    "page_html": "\u003C!DOCTYPE html\u003E\n\u003Chtml\u003E\u003Chead\u003E\n  \u003CMETA HTTP-EQUIV=\u0022Content-Type\u0022 CONTENT=\u0022text\/html; charset=UTF-8\u0022\u003E\n  \u003Clink rel=\u0022appl...",
    "ld_json": null,
    "page_title": null
  },
  {
    "timestamp": "2025-04-20",
    "markdown": null,
    "url": "https:\/\/www.thesoullux.com\/",
    "final_url": null,
    "html2text": null,
    "page_html": "\u003C!doctype html\u003E\r\n\u003Chtml lang=\u0022en-US\u0022\u003E\r\n\u003Chead\u003E\r\n  \u003Cmeta charset=\u0022UTF-8\u0022\u003E\r\n  \u003Cmeta name=\u0022viewport\u0022 content=\u0022width=devic...",
    "ld_json": null,
    "page_title": null
  },
  {
    "timestamp": "2025-02-24",
    "markdown": null,
    "url": "https:\/\/www.mindat.org\/loc-416126.html",
    "final_url": null,
    "html2text": null,
    "page_html": "\u003C!DOCTYPE html\u003E\n\u003Chtml\u003E\u003Chead\u003E\n  \u003CMETA HTTP-EQUIV=\u0022Content-Type\u0022 CONTENT=\u0022text\/html; charset=UTF-8\u0022\u003E\n  \u003Clink rel=\u0022appl...",
    "ld_json": null,
    "page_title": null
  },
  {
    "timestamp": "2025-03-31",
    "markdown": "[Skip to content](#theme-main) \n\n[ ![](https:\/\/www.senuto.com\/wp-content\/themes\/picostrap5\/assets\/img\/senuto-logo-black....",
    "url": "https:\/\/www.senuto.com\/pl\/blog\/promocja-sklepu-internetowego\/",
    "final_url": null,
    "html2text": null,
    "page_html": null,
    "ld_json": null,
    "page_title": null
  },
  {
    "timestamp": "2025-04-16",
    "markdown": null,
    "url": "https:\/\/www.indiamart.com\/panchal-healthcare\/",
    "final_url": null,
    "html2text": null,
    "page_html": "\u003C!DOCTYPE HTML\u003E\r\n\u003Chtml lang=\u0022en\u0022 id=\u0022html_job\u0022\u003E\r\n\u003Chead\u003E\r\n\u003Clink rel=\u0022dns-prefetch\u0022 href=\u0022https:\/\/utils.imimg.com\/\u0022\u003E\r\n\u003Clin...",
    "ld_json": null,
    "page_title": null
  }
]
Start free

Web Scraper API Library

Fetching the same sites again and again? There's probably a scraper for that already. Pick one and get parsed JSON, with output fields, delivery volume, and live success rate listed up front.

Explore thousands of production-ready scrapers

Pay only for successful results, no surprises – Proxies, unlocking, browsers and retries are built in.

TERMINAL

Tell your agent:

Read https://brightdata.com/SKILL.md and use Fetch to read this Nike Vomero Plus product page as Markdown: https://www.nike.com/t/vomero-plus-mens-road-running-shoes-5npsVBwT/IM8336-100

Or run it yourself:

npx -p @brightdata/cli bdata scrape "https://www.nike.com/t/vomero-plus-mens-road-running-shoes-5npsVBwT/IM8336-100" -f markdown

Or connect over MCP:

https://mcp.brightdata.com/mcp?token=YOUR_API_KEY
Get your token-filled URL in the control panel
For coding Agents

Give your agent the whole web with Fetch API

Your agent passes any URL to Fetch API and gets the page back clean, ready to read. Bright Data handles blocks, CAPTCHAs and retries, so every call returns real-time web data instead of an error page. Works in Claude Code, Codex, Cursor and any other coding agent.

  • Runs with npx, nothing to install
  • bdata login opens browser auth, no key to paste
  • Name a scraper, get JSON back
  • Delivers to AWS · GCP · Azure · Snowflake · Webhook
compliance

Leading the way in ethical web data collection

Only publicly available data. ISO 27001 certified, SOC 2 controls, GDPR & CCPA compliant. Every use case is reviewed by a dedicated Compliance & Ethics team, backed by a documented Know Your Customer process and Acceptable Use Policy.



World's #1 scraping platform

Everything you need, built in

You pay for results. Proxies, rendering, concurrency, and delivery are always included, on every plan.

Go straight to the source

Every request runs on Bright Data infrastructure. 400M+ IPs, unlocking and browsers are built in.

Scale to millions of pages instantly

Send unlimited concurrent requests - no infrastructure to manage, no configs to change.

Scrapers auto-fix when sites change

AI-powered self-healing detects site changes and repairs scrapers. Your pipelines keep running.

Thousands of verified scrapers

Every scraper is built, tested, and maintained by Bright Data. No community guesswork.

Pay per result, nothing extra

One price per record . Proxies, retries, rendering, unblocking - all included, no surprises.

Compliant and fully supported

GDPR & CCPA compliant. 24/7 human support on every plan, including free.
Compare Bright Data to others

Fetch API vs other providers

Capability
Other scraping providers
Auto-scaling infrastructure
Unlimited
Partial
Anti-bot & CAPTCHA bypass
Built-in
Partial
Residential proxy network
400M+ IPs
Limited pool
Pre-built scrapers
1,400+
50–200
Auto-maintenance (site changes)
24/7
Depends on who built it
Pricing model
One all-in price per record
Compute, proxy, and storage metered separately
Failed requests
Free, pay only for success
Often billed
Custom sites (no pre-built scraper)
AI builds it in minutes, self-healing included
Community-built scrapers, no SLA
Compliance (GDPR, CCPA, SOC 2)
Full
Partial
Structured output (JSON/CSV)
Automatic
Support
24/7 experts, even on the free tier
Community forum
Free tier
5K records/mo
Varies
Bright Data is used by world's top brands

Fetch API FAQ

Fetch API (formerly Crawl API) turns any public URL into Markdown, plain text, raw HTML and JSON-LD in a single record. Bright Data handles proxies, CAPTCHAs and blocking, and returns page content ready for an LLM or a parser.

Both unblock public web pages. They differ in how you call them and what you get back:

  • Web Unlocker API is called at /request with a Web Unlocker zone and returns the target page's raw response.
  • Fetch API is called at /datasets/v3/scrape or /datasets/v3/trigger with a dataset ID and needs no zone. Each URL comes back as one record with Markdown, plain text, raw HTML and JSON-LD together, and it works with Scraper API batch jobs and delivery options.

Each record includes markdown (headings, lists and links kept), html2text (visible text only), page_html (the full HTML source) and ld_json (schema.org metadata, when the page has any), plus url, final_url, page_title and country. Results can be downloaded as JSON, NDJSON, JSON lines, CSV or Parquet.

We recommend single URL request use synchronous request. For larger volumes, use the async /trigger endpoint, which accepts unlimited URLs (up to 1 GB of input per job).

Yes. Every request fetches the live page, with no cached copy. A synchronous request waits up to 1 minute. If the fetch takes longer, it returns a snapshot_id and finishes in the background.

Yes. Add a two-letter country code in uppercase, for example US or DE, to any input URL, and the page is fetched from that country.

Any public URL on any domain. Fetch API returns page content, not site-specific fields such as prices or follower counts. For those fields, use one of our pre-built scrapers.

No. Fetch API returns page content from a URL. If you need to control a browser with Puppeteer, Playwright or similar tools, check out our Browser API.

You pay only for successful records. New accounts get 5,000 free credits every month, with no credit card required.

Yes. Proxies, CAPTCHAs and blocking are handled automatically on every request, with no configuration needed on your side.