AI Web Scraper Scraper API

Scrape AI search engines with one API. Collect data such as prompt, answer text, answer HTML, citations, attached links, country, and answer URL across ChatGPT, Gemini, Perplexity, Copilot and Google AI Mode.

Contact sales Start freegoogle social icon
5K free records/month · Credit card not required

Trusted by 50,000+ customers worldwide
Top Scrapers
Pricing
Code examples
AI Agents
Compliance
FAQs
Start free
AI Web Scrapers

AI Web Scraper API Library

Remove the complexity of traditional scraping with intelligent AI tools. Extract high-volume data with unparalleled accuracy and efficiency.

ChatGPT Search

URL, Prompt, Answer html, Answer text, Links attached, Citations, Country, Is map, and more.
Views324+
Downloads306+
Start free

Google AI Mode Search

URL, Prompt, Answer html, Answer text, Links attached, Citations, Index, Country, and more.
Views271+
Downloads77+
Start free

Gemini Search

URL, Prompt, Answer html, Answer text, Links attached, Citations, Country, Index, and more.
Views247+
Downloads69+
Start free

Perplexity Search

URL, Prompt, Answer html, Answer text, Answer text markdown, Sources, Source html, Is shopping data, and more.
Views243+
Downloads92+
Start free

Explore thousands of production-ready scrapers

Pay only for successful results, no surprises – Proxies, unlocking, browsers and retries are built in.

Start free

#1

Ranked (by AIMultiple)

99.2%

Avg. success rate

100M+

Requests weekly

400M+

Proxy IPs built in

GDPR & CCPA

Compliant
Pricing

AI Web Scraper API Pricing

Only pay for what’s successfully delivered. No hidden fees, no charges for failed deliveries.

CALCULATE YOUR COST
Records per month: 5K
$/mo
$ per 1,000 records
Your whole bill. Proxies, unblocking, parsing included.
Get started
5K
10K
50K
100K
500K
1M
5M
  • Pay only for success, no hidden fees
  • Start free with 5,000 monthly credits
  • No upfront commitment, cancel anytime
  • 24/7 expert support and enterprise features
Free Tier
5K
records
Start free
  • 5K records per month
  • No credit card required
  • Expert support
Pay as you go
$1.5/1K record
Start free
  • Pay only for success
  • Set monthly spend limits
  • Unlimited concurrency
  • Expert support
Scale
$499 /month
Start free
  • 384,000 records included
  • $1.3/1K additional records
  • Unlimited concurrency
  • Cancel anytime
  • Expert support
Enterprise
Custom
Talk to sales
  • Volume discounts
  • Account manager
  • Premium SLA
  • Priority support
  • SSO
Most platforms stack extra charges on top of the per-record rate. With Bright Data, the record price is the whole bill:
Compute / runtime units
commonly billed per scraper runtime hour or compute unit
Included
Residential proxy bandwidth
commonly billed per GB
Included
Storage & dataset retention
commonly billed per GB-month
Included
Data transfer / egress
commonly billed per GB out
Included
Unblocking & CAPTCHA solving
commonly a paid add-on
Included
Parsing to structured JSON
commonly your own code
Included
We accept these payment methods:

Just want data? Skip scraping.
Purchase a AI Web dataset

How it works

From zero to AI Web data in 3 steps

No proxies to configure, no infrastructure to manage. Pick, call, and receive.

  1. Pick a scraper

    Choose from the AI Web scrapers above or create your own with AI in minutes.

  2. Call the API

    One API call with up to 5,000 target URLs. Python and Node.js SDKs, CLI, MCP server, or any HTTP client.

  3. Get structured data

    Receive clean, parsed AI Web data in JSON, NDJSON, or CSV. Delivered via API, webhook, or cloud storage.

Scraper API Call 
curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://chatgpt.com/","prompt":"Top hotels in New York","country":"","additional_prompt":"","web_search":false,"geolocation":""},{"url":"https://chatgpt.com/","prompt":"What are the biggest business trends to watch in the next five years?","country":"","additional_prompt":"","web_search":false,"geolocation":"37.7749,122.4194"},{"url":"https://chatgpt.com/","prompt":"Analyze the key factors that influence customer buying decisions in online marketplaces.","country":"","additional_prompt":"","web_search":false,"geolocation":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_m7aof0k82r803d5bjm&format=json&uncompressed_webhook=true"
Response payload 
[
  {
    "timestamp": "2026-08-23",
    "url": "https:\/\/chatgpt.com\/?q=%E3%83%8B%E3%83%A5%E3%83%BC%E3%83%90%E3%83%A9%E3%83%B3%E3%82%B9%E3%81%AE%E4%BA%BA%E6%B0%97%E5%B1%...",
    "prompt": "ニューバランスの人気層は？",
    "answer_html": "\u003Chtml lang=\u0022en-US\u0022 data-build=\u0022prod-46437587156517d920436051cb9ab60a95f0503a\u0022 data-seq=\u00229723596\u0022 data-contrast=\u0022default\u0022...",
    "answer_text": "はい。**ニューバランス（New Balance）の人気層は、かなり「大人・女性寄り」**と見るのが近いです。2026年の調査を中心に見ると、特に以下が強いです。 人気が強い層 30〜50代女性 2026年のSODA調査では、女性が「よく購...",
    "links_attached": [
      {
        "position": 1,
        "text": "プレスリリース・ニュースリリース配信シェアNo.1｜PR TIMES +1",
        "url": "https:\/\/prtimes.jp\/main\/html\/rd\/p\/000000152.000043703.html?utm_source=chatgpt.com"
      },
      {
        "position": 2,
        "text": "プレスリリース・ニュースリリース配信シェアNo.1｜PR TIMES",
        "url": "https:\/\/prtimes.jp\/main\/html\/rd\/p\/000000197.000064613.html?utm_source=chatgpt.com"
      },
      {
        "position": 3,
        "text": "プレスリリース・ニュースリリース配信シェアNo.1｜PR TIMES",
        "url": "https:\/\/prtimes.jp\/main\/html\/rd\/p\/000000152.000043703.html?utm_source=chatgpt.com"
      },
      {
        "position": 4,
        "text": "SHOES MASTER",
        "url": "https:\/\/www.shoesmaster.jp\/news\/2022\/04\/about-new-balance-hidefumi-hommyofoot-locker-atmos-japan-ceo-interview.html?utm_..."
      },
      {
        "position": 5,
        "text": "クロス・マーケティング +1",
        "url": "https:\/\/www.cross-m.co.jp\/news\/release\/20260408?utm_source=chatgpt.com"
      }
    ],
    "citations": [
      {
        "answer_position": 1,
        "cited": true,
        "description": "March 18, 2026",
        "domain": "プレスリリース・ニュースリリース配信シェアNo.1｜PR TIMES",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/prtimes.jp\u0026sz=32",
        "position": 1,
        "title": "〖スニーカーの購買に関する実態調査 2026〗 | 株式会社SODAのプレスリリース",
        "url": "https:\/\/prtimes.jp\/main\/html\/rd\/p\/000000152.000043703.html?utm_source=chatgpt.com"
      },
      {
        "answer_position": 2,
        "cited": true,
        "description": "",
        "domain": "繊研新聞",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/senken.co.jp\u0026sz=32",
        "position": 2,
        "title": "〖スニーカーの購買に関する実態調査 2026〗 | 繊研新聞",
        "url": "https:\/\/senken.co.jp\/prtimes\/aHR0cHM6Ly9wcnRpbWVzLmpwL21haW4vaHRtbC9yZC9wLzAwMDAwMDE1Mi4wMDAwNDM3MDMuaHRtbA%3D%3D?utm_so..."
      },
      {
        "answer_position": 3,
        "cited": true,
        "description": "April 23, 2026",
        "domain": "プレスリリース・ニュースリリース配信シェアNo.1｜PR TIMES",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/prtimes.jp\u0026sz=32",
        "position": 3,
        "title": "〖1,000人調査〗スニーカー選びはSNSより\u0022自分の足\u0022が決める | アイブリッジ株式会社のプレスリリース",
        "url": "https:\/\/prtimes.jp\/main\/html\/rd\/p\/000000197.000064613.html?utm_source=chatgpt.com"
      },
      {
        "answer_position": 4,
        "cited": true,
        "description": "April 13, 2022",
        "domain": "SHOES MASTER",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.shoesmaster.jp\u0026sz=32",
        "position": 4,
        "title": "About New Balance Hidefumi Hommyo(Foot Locker atmos Japan CEO) Interview | SHOES MASTER",
        "url": "https:\/\/www.shoesmaster.jp\/news\/2022\/04\/about-new-balance-hidefumi-hommyofoot-locker-atmos-japan-ceo-interview.html?utm_..."
      },
      {
        "answer_position": 5,
        "cited": true,
        "description": "April 8, 2026",
        "domain": "クロス・マーケティング",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.cross-m.co.jp\u0026sz=32",
        "position": 5,
        "title": "〖お知らせ〗スニーカーに関する調査（2026年） | リサーチ・市場調査ならクロス・マーケティング",
        "url": "https:\/\/www.cross-m.co.jp\/news\/release\/20260408?utm_source=chatgpt.com"
      },
      {
        "answer_position": 6,
        "cited": true,
        "description": "",
        "domain": "クロス・マーケティング",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.cross-m.co.jp\u0026sz=32",
        "position": 6,
        "title": "スニーカーに関する調査（2026年） | リサーチ・市場調査ならクロス・マーケティング",
        "url": "https:\/\/www.cross-m.co.jp\/report\/trend-eye\/20260408sneakers?utm_source=chatgpt.com"
      },
      {
        "answer_position": 7,
        "cited": false,
        "description": "June 24, 2026 — * # 買う前にチェック！年代×性別で選ぶスニーカーブランドランキング 1,000人調査  2026 6\/24  買い物  Image: 買う前にチェック！年代×性別で選ぶスニーカーブランドランキング 1,0...",
        "domain": "rankplus.co.jp",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/rankplus.co.jp\u0026sz=32",
        "position": 7,
        "title": "スニーカーブランドランキング｜年代×性別で1位が変わる｜Rank+（ランクプラス）",
        "url": "https:\/\/rankplus.co.jp\/sneaker-brand-ranking\/?utm_source=chatgpt.com"
      },
      {
        "answer_position": 8,
        "cited": false,
        "description": "May 11, 2026 — ナイキ・アディダスを抑えて「好意度1位」はニューバランスに｜スニーカーブランドについてのアンケート  2026年5月11日  * アンケート調査  Image: スニーカーブランドについてのアンケート  スニー...",
        "domain": "mrs.co.jp",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.mrs.co.jp\u0026sz=32",
        "position": 8,
        "title": "ナイキ・アディダスを抑えて「好意度1位」はニューバランスに｜スニーカーブランドについてのアンケート | digmar",
        "url": "https:\/\/www.mrs.co.jp\/digmar\/2026\/05\/11\/8160\/?utm_source=chatgpt.com"
      }
    ],
    "supporting_sources": null
  },
  {
    "timestamp": "2025-09-20",
    "url": "https:\/\/chatgpt.com\/?model=gpt-4\u0026q=marketing%20performance%20tracking%20software%20with%20instant%20notifications",
    "prompt": "marketing performance tracking software with instant notifications",
    "answer_html": "\u003Chtml lang=\u0022en-US\u0022 data-build=\u0022prod-800a5d23d3902cc6f2d442f787055dfa675717ea\u0022 dir=\u0022ltr\u0022 class=\u0022light\u0022 data-chat-theme=\u0022u...",
    "answer_text": "Here are some marketing performance tracking tools\/software that offer real‑time or near‑real‑time tracking + instant\/au...",
    "links_attached": [
      {
        "position": 1,
        "text": "HawkeAI",
        "url": "https:\/\/hawke.ai\/features\/alerts\/?utm_source=chatgpt.com"
      },
      {
        "position": 2,
        "text": "HawkeAI",
        "url": "https:\/\/hawke.ai\/features\/alerts\/?utm_source=chatgpt.com"
      },
      {
        "position": 3,
        "text": "campaign-iq.com",
        "url": "https:\/\/campaign-iq.com\/front-pages\/help-center\/article\/ai-monitoring-alerting?utm_source=chatgpt.com"
      },
      {
        "position": 4,
        "text": "campaign-iq.com",
        "url": "https:\/\/campaign-iq.com\/front-pages\/help-center\/article\/ai-monitoring-alerting?utm_source=chatgpt.com"
      },
      {
        "position": 5,
        "text": "Singular",
        "url": "https:\/\/www.singular.net\/marketing-automation\/advertising-alerts\/?utm_source=chatgpt.com"
      },
      {
        "position": 6,
        "text": "Singular",
        "url": "https:\/\/www.singular.net\/marketing-automation\/advertising-alerts\/?utm_source=chatgpt.com"
      },
      {
        "position": 7,
        "text": "Zapier 2+ Zapier 2+",
        "url": "https:\/\/zapier.com\/automation\/campaign-automation\/campaign-performance?utm_source=chatgpt.com"
      },
      {
        "position": 8,
        "text": "Zapier 2+ Zapier 2+",
        "url": "https:\/\/zapier.com\/automation\/use-case\/notify-team-members-about-campaign-activities-and-updates?utm_source=chatgpt.com"
      }
    ],
    "citations": [
      {
        "cited": true,
        "description": null,
        "domain": "HawkeAI",
        "icon": null,
        "title": "PPC performance \u0026 budget overspend alerts | Hawke AI",
        "url": "https:\/\/hawke.ai\/features\/alerts\/?utm_source=chatgpt.com"
      },
      {
        "cited": true,
        "description": null,
        "domain": "campaign-iq.com",
        "icon": null,
        "title": "Campaign-IQ - Unlock Smarter Insights",
        "url": "https:\/\/campaign-iq.com\/front-pages\/help-center\/article\/ai-monitoring-alerting?utm_source=chatgpt.com"
      },
      {
        "cited": true,
        "description": null,
        "domain": "Singular",
        "icon": null,
        "title": "Automated Alerts for Digital Marketing Campaign Management | Singular",
        "url": "https:\/\/www.singular.net\/marketing-automation\/advertising-alerts\/?utm_source=chatgpt.com"
      },
      {
        "cited": true,
        "description": null,
        "domain": "Zapier",
        "icon": null,
        "title": "Campaign Performance Automation",
        "url": "https:\/\/zapier.com\/automation\/campaign-automation\/campaign-performance?utm_source=chatgpt.com"
      },
      {
        "cited": true,
        "description": null,
        "domain": "Zapier",
        "icon": null,
        "title": "Real-time campaign alerts",
        "url": "https:\/\/zapier.com\/automation\/use-case\/notify-team-members-about-campaign-activities-and-updates?utm_source=chatgpt.com"
      },
      {
        "cited": true,
        "description": null,
        "domain": "PandaFlow",
        "icon": null,
        "title": "Campaign Performance Alert",
        "url": "https:\/\/www.pandaflow.io\/integration-workflow\/campaign_performance_alert?utm_source=chatgpt.com"
      },
      {
        "cited": false,
        "description": "1. Campaign Automation 2. Campaign Tracking  CAMPAIGN TRACKING  Campaign Tracking automations connect your ads, forms, a...",
        "domain": "zapier.com",
        "icon": null,
        "title": "Campaign Tracking Automation",
        "url": "https:\/\/zapier.com\/automation\/campaign-automation\/campaign-tracking?utm_source=chatgpt.com"
      },
      {
        "cited": false,
        "description": "CAMPAIGN AUTOMATION  Campaign Automation at Zapier connects your marketing tools so every campaign—from setup to perform...",
        "domain": "zapier.com",
        "icon": null,
        "title": "Campaign Automation",
        "url": "https:\/\/zapier.com\/automation\/campaign-automation?utm_source=chatgpt.com"
      }
    ],
    "supporting_sources": null
  },
  {
    "timestamp": "2026-07-26",
    "url": "https:\/\/chatgpt.com\/?q=Caracter%C3%ADsticas%20do%20Samsung%20A04?",
    "prompt": "Características do Samsung A04?",
    "answer_html": "\u003Chtml lang=\u0022en-US\u0022 data-build=\u0022prod-e8497aa680429620e23ba27b611a587d1a9b62ec\u0022 data-seq=\u00228625343\u0022 data-contrast=\u0022default\u0022...",
    "answer_text": "O Samsung Galaxy A04 é um celular de entrada lançado em 2022, voltado para tarefas do dia a dia, como WhatsApp, redes so...",
    "links_attached": [
      {
        "position": 1,
        "text": "Samsung Mobile Press +1",
        "url": "https:\/\/samsungmobilepress.com\/media-assets\/galaxy-a04?tab=specs\u0026utm_source=chatgpt.com"
      },
      {
        "position": 2,
        "text": "Samsung Mobile Press +1",
        "url": "https:\/\/samsungmobilepress.com\/media-assets\/galaxy-a04?tab=specs\u0026utm_source=chatgpt.com"
      },
      {
        "position": 3,
        "text": "Tech Advisor Brasil +1",
        "url": "https:\/\/www.techadvisor.com.br\/dispositivo\/samsung-galaxy-a04-6?utm_source=chatgpt.com"
      }
    ],
    "citations": [
      {
        "answer_position": 1,
        "cited": true,
        "description": "",
        "domain": "Samsung Mobile Press",
        "icon": null,
        "position": 1,
        "title": "Galaxy A04 | Samsung Mobile Press",
        "url": "https:\/\/samsungmobilepress.com\/media-assets\/galaxy-a04?tab=specs\u0026utm_source=chatgpt.com"
      },
      {
        "answer_position": 2,
        "cited": true,
        "description": "",
        "domain": "Wikipédia",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/pt.wikipedia.org\u0026sz=32",
        "position": 2,
        "title": "Samsung Galaxy A04",
        "url": "https:\/\/pt.wikipedia.org\/wiki\/Samsung_Galaxy_A04?utm_source=chatgpt.com"
      },
      {
        "answer_position": 3,
        "cited": true,
        "description": "",
        "domain": "Tech Advisor Brasil",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.techadvisor.com.br\u0026sz=32",
        "position": 3,
        "title": "Samsung Galaxy A04 — Ficha Técnica e Preços | Tech Advisor Brasil",
        "url": "https:\/\/www.techadvisor.com.br\/dispositivo\/samsung-galaxy-a04-6?utm_source=chatgpt.com"
      },
      {
        "answer_position": 4,
        "cited": true,
        "description": "",
        "domain": "canaltech.com.br",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/canaltech.com.br\u0026sz=32",
        "position": 4,
        "title": "Samsung Galaxy A04 - Ficha Técnica - Canaltech",
        "url": "https:\/\/canaltech.com.br\/produto\/samsung\/galaxy-a04\/?utm_source=chatgpt.com"
      },
      {
        "answer_position": 5,
        "cited": false,
        "description": "January 21, 2026 — SAMSUNG GALAXY A04  Revisado pelo Editor da Celulares.com | Atualizado em 22 de janeiro de 2026 às 14...",
        "domain": "celulares.com",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/br.celulares.com\u0026sz=32",
        "position": 5,
        "title": "Samsung Galaxy A04 - Celulares.com Brasil",
        "url": "https:\/\/br.celulares.com\/samsung\/galaxy-a04-core?utm_source=chatgpt.com"
      },
      {
        "answer_position": 6,
        "cited": false,
        "description": "February 5, 2024 — POWER THAT KEEPS YOU GOING  The 5,000mAh (typical)¹ battery lets you keep doing what you do, for hour...",
        "domain": "samsung.com",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.samsung.com\u0026sz=32",
        "position": 6,
        "title": "Galaxy A04 128GB (SM-A045FZKHPHL) Specs | Samsung Philippines",
        "url": "https:\/\/www.samsung.com\/ph\/smartphones\/galaxy-a\/galaxy-a04-black-128gb-sm-a045fzkhphl\/?utm_source=chatgpt.com"
      },
      {
        "answer_position": 7,
        "cited": false,
        "description": "February 26, 2023 — SAMSUNG ANUNCIA GALAXY A04S NO BRASIL  27-02-2023  * X * Facebook * Mail  Image: Mail  [Input] [Butt...",
        "domain": "samsung.com",
        "icon": null,
        "position": 7,
        "title": "Samsung anuncia Galaxy A04s no Brasil – Samsung Newsroom Brasil",
        "url": "https:\/\/news.samsung.com\/br\/samsung-anuncia-galaxy-a04s-no-brasil?utm_source=chatgpt.com"
      },
      {
        "answer_position": 8,
        "cited": false,
        "description": "January 23, 2023 — 0%  Você está lendo...Inicio  GALAXY A04: CONHEÇA O CELULAR SAMSUNG BARATO  Veja a ficha-técnica do G...",
        "domain": "buscape.com.br",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.buscape.com.br\u0026sz=32",
        "position": 8,
        "title": "Galaxy A04 vale à pena? Conheça o celular Samsung barato",
        "url": "https:\/\/www.buscape.com.br\/celular\/conteudo\/galaxy-a04-ficha-tecnica?utm_source=chatgpt.com"
      }
    ],
    "supporting_sources": null
  },
  {
    "timestamp": "2025-10-17",
    "url": "https:\/\/chatgpt.com\/?model=gpt-4\u0026q=Welche%20Unterschiede%20gibt%20es%20zwischen%20Gasherd-T%C3%B6pfen%20und%20normalen%2...",
    "prompt": "Welche Unterschiede gibt es zwischen Gasherd-Töpfen und normalen Töpfen, die ich beachten sollte? (The user\u0027s location i...",
    "answer_html": "\u003Chtml lang=\u0022en-US\u0022 data-build=\u0022prod-b0f8c9e9434b647fcf7cd70387567e52152f9504\u0022 dir=\u0022ltr\u0022 class=\u0022light\u0022 data-chat-theme=\u0022u...",
    "answer_text": "Wenn man mit Gas kocht, gibt es ein paar Besonderheiten bei Töpfen\/Pfannen, die man beachten sollte, damit das Kochergeb...",
    "links_attached": [
      {
        "position": 1,
        "text": "mylechner.de 3+ KitchenAid 3+ Top Ten Reviews 3+",
        "url": "https:\/\/www.kitchenaid.com\/pinch-of-help\/major-appliances\/gas-vs-electric-stove.html?utm_source=chatgpt.com"
      },
      {
        "position": 2,
        "text": "Angi 2+ Top Ten Reviews 2+",
        "url": "https:\/\/www.angi.com\/articles\/gas-vs-electric-stove.htm?utm_source=chatgpt.com"
      },
      {
        "position": 3,
        "text": "bauknecht.de 1+",
        "url": "https:\/\/www.bauknecht.de\/magazin\/kochen-backen\/kuechentipps\/kochfelder-kochgeschirr?utm_source=chatgpt.com"
      },
      {
        "position": 4,
        "text": "mylechner.de 1+",
        "url": "https:\/\/www.mylechner.de\/magazin\/d\/toepfe-fuer-den-gasherd-so-treffen-sie-die-richtige-wahl\/?utm_source=chatgpt.com"
      },
      {
        "position": 5,
        "text": "mylechner.de 1+",
        "url": "https:\/\/www.mylechner.de\/magazin\/d\/toepfe-fuer-den-gasherd-so-treffen-sie-die-richtige-wahl\/?utm_source=chatgpt.com"
      },
      {
        "position": 6,
        "text": "mylechner.de",
        "url": "https:\/\/www.mylechner.de\/magazin\/d\/toepfe-fuer-den-gasherd-so-treffen-sie-die-richtige-wahl\/?utm_source=chatgpt.com"
      },
      {
        "position": 7,
        "text": "mylechner.de",
        "url": "https:\/\/www.mylechner.de\/magazin\/d\/toepfe-fuer-den-gasherd-so-treffen-sie-die-richtige-wahl\/?utm_source=chatgpt.com"
      },
      {
        "position": 8,
        "text": "bauknecht.de",
        "url": "https:\/\/www.bauknecht.de\/magazin\/kochen-backen\/kuechentipps\/kochfelder-kochgeschirr?utm_source=chatgpt.com"
      }
    ],
    "citations": [
      {
        "cited": true,
        "description": null,
        "domain": "KitchenAid",
        "icon": null,
        "title": "Gas vs. Electric Stoves: What’s the Difference? | KitchenAid",
        "url": "https:\/\/www.kitchenaid.com\/pinch-of-help\/major-appliances\/gas-vs-electric-stove.html?utm_source=chatgpt.com"
      },
      {
        "cited": true,
        "description": null,
        "domain": "Angi",
        "icon": null,
        "title": "Gas vs. Electric Stoves: Key Differences | Angi",
        "url": "https:\/\/www.angi.com\/articles\/gas-vs-electric-stove.htm?utm_source=chatgpt.com"
      },
      {
        "cited": true,
        "description": null,
        "domain": "bauknecht.de",
        "icon": null,
        "title": "Kochfelder \u0026 Kochgeschirr - Bauknecht",
        "url": "https:\/\/www.bauknecht.de\/magazin\/kochen-backen\/kuechentipps\/kochfelder-kochgeschirr?utm_source=chatgpt.com"
      },
      {
        "cited": true,
        "description": null,
        "domain": "mylechner.de",
        "icon": null,
        "title": "Töpfe für den Gasherd – so treffen Sie die richtige Wahl",
        "url": "https:\/\/www.mylechner.de\/magazin\/d\/toepfe-fuer-den-gasherd-so-treffen-sie-die-richtige-wahl\/?utm_source=chatgpt.com"
      },
      {
        "cited": true,
        "description": null,
        "domain": "Magazin",
        "icon": null,
        "title": "Töpfe \u0026 Pfannen: Die einzige Übersicht, die Sie brauchen werden - Magazin",
        "url": "https:\/\/magazin.moebelheinrich.de\/toepfe-pfannen-die-einzige-uebersicht-die-sie-brauchen-werden\/?utm_source=chatgpt.com"
      },
      {
        "cited": false,
        "description": "Skip to main content  1. Education center 2. Credit cards 3. Credit card basics  Credit Card Marketplace  ELECTRIC VS. G...",
        "domain": "chase.com",
        "icon": null,
        "title": "Electric vs. Gas Stove: Learn the Key Differences | Chase",
        "url": "https:\/\/www.chase.com\/personal\/credit-cards\/education\/basics\/electric-vs-gas-stove?utm_source=chatgpt.com"
      },
      {
        "cited": false,
        "description": "SAFETY  Gas stoves pose the risk of potential gas leaks and the fire risks associated with the use of open flames in the...",
        "domain": "popularmechanics.com",
        "icon": null,
        "title": "Gas Stove vs. Electric Stove: Which Is Better?",
        "url": "https:\/\/www.popularmechanics.com\/home\/tools\/a44967012\/gas-vs-electric-stove\/?utm_source=chatgpt.com"
      },
      {
        "cited": false,
        "description": "3 DIE BESTEN TOPFSETS  KARCHER TOPFSET MIA AUS EDELSTAHL  Kärcher  9.45 x 9.45 x 3.54 zoll  11.46 pfund  Karcher Topfset...",
        "domain": "findthisbest.com",
        "icon": null,
        "title": "Topf- \u0026 Pfannensets für Gasherd geeignet Test \u0026 Vergleich 2025: Die 4 besten - FindThisBest (DE)",
        "url": "https:\/\/de.findthisbest.com\/f\/topf-pfannensets\/gasherd-geeignet?utm_source=chatgpt.com"
      }
    ],
    "supporting_sources": null
  },
  {
    "timestamp": "2026-08-07",
    "url": "https:\/\/chatgpt.com\/?q=What%20compact%20makeup%20tools%20are%20best%20for%20travel%20between%20Australian%20cities%20and...",
    "prompt": "What compact makeup tools are best for travel between Australian cities and overseas trips?",
    "answer_html": "\u003Chtml lang=\u0022en-US\u0022 data-build=\u0022prod-e1d6f2820dd20c3bab36cc42e8668035bf87f7bc\u0022 data-seq=\u00229052945\u0022 data-contrast=\u0022default\u0022...",
    "answer_text": "For travel between Australian cities and overseas, the most useful makeup tools are the ones that are compact, durable, ...",
    "links_attached": [
      {
        "position": 1,
        "text": "Melbourne Airport +1",
        "url": "https:\/\/www.melbourneairport.com.au\/the-best-travel-size-beauty-products-to-pack-in-your-carry-on?utm_source=chatgpt.com"
      },
      {
        "position": 2,
        "text": "Reddit +1",
        "url": "https:\/\/www.reddit.com\/r\/AustralianMakeup\/comments\/1ug3f9u\/makeup_that_travels_well\/?utm_source=chatgpt.com"
      },
      {
        "position": 3,
        "text": "Town \u0026 Country +1",
        "url": "https:\/\/www.townandcountrymag.com\/style\/beauty-products\/a73357862\/afform-traveller-makeup-bag-review\/?utm_source=chatgpt..."
      }
    ],
    "citations": [
      {
        "answer_position": 1,
        "cited": true,
        "description": "",
        "domain": "Melbourne Airport",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.melbourneairport.com.au\u0026sz=32",
        "position": 1,
        "title": "The Best Travel-Size Beauty Products to Pack in Your Carry-On | Melbourne Airport",
        "url": "https:\/\/www.melbourneairport.com.au\/the-best-travel-size-beauty-products-to-pack-in-your-carry-on?utm_source=chatgpt.com"
      },
      {
        "answer_position": 2,
        "cited": true,
        "description": "",
        "domain": "Melbourne Airport",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.melbourneairport.com.au\u0026sz=32",
        "position": 2,
        "title": "Carry-On Ready Must-Have Duty Free Travel Minis for Your Next Flight | Melbourne Airport",
        "url": "https:\/\/www.melbourneairport.com.au\/carry-on-ready-must-have-duty-free-travel-minis-for-your-next-flight?utm_source=chat..."
      },
      {
        "answer_position": 3,
        "cited": true,
        "description": "June 26, 2026",
        "domain": "Reddit",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.reddit.com\u0026sz=32",
        "position": 3,
        "title": "Makeup that travels well",
        "url": "https:\/\/www.reddit.com\/r\/AustralianMakeup\/comments\/1ug3f9u\/makeup_that_travels_well\/?utm_source=chatgpt.com"
      },
      {
        "answer_position": 4,
        "cited": true,
        "description": "",
        "domain": "Reddit",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.reddit.com\u0026sz=32",
        "position": 4,
        "title": "On the go makeup bag",
        "url": "https:\/\/www.reddit.com\/r\/AustralianMakeup\/comments\/1rs7mpn\/on_the_go_makeup_bag\/?utm_source=chatgpt.com"
      },
      {
        "answer_position": 5,
        "cited": true,
        "description": "Yesterday — The article from T\u0026C’s “Tried \u0026 True” series discusses an editor’s favorite cosmetic case, especially for fr...",
        "domain": "Town \u0026 Country",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.townandcountrymag.com\u0026sz=32",
        "position": 5,
        "title": "T\u0026C Tried \u0026 True: A Cosmetic Case for Hyper-Organized Travelers",
        "url": "https:\/\/www.townandcountrymag.com\/style\/beauty-products\/a73357862\/afform-traveller-makeup-bag-review\/?utm_source=chatgpt..."
      },
      {
        "answer_position": 6,
        "cited": true,
        "description": "The article is a review of the Afform Traveller Makeup Bag, which the author, a frequent traveler, found to be a game-ch...",
        "domain": "The Wall Street Journal",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/www.wsj.com\u0026sz=32",
        "position": 6,
        "title": "The Afform Traveller Makeup Bag Changed How I Pack for Trips",
        "url": "https:\/\/www.wsj.com\/buyside\/travel\/travel-gear\/afform-traveller-makeup-bag-review?utm_source=chatgpt.com"
      },
      {
        "answer_position": 7,
        "cited": false,
        "description": "July 9, 2026 — IPSY TRAVEL SIZE MAKEUP PRODUCTS TO PACK FOR YOUR NEXT TRIP  by Katie Wallace | Updated: July 9, 2026  Pa...",
        "domain": "createplaytravel.com",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/createplaytravel.com\u0026sz=32",
        "position": 7,
        "title": "IPSY Travel Size Makeup Products to Pack for Your Next Trip - Create. Play. Travel.",
        "url": "https:\/\/createplaytravel.com\/beauty-tips\/travel-size-makeup-products-ipsy\/?utm_source=chatgpt.com"
      },
      {
        "answer_position": 8,
        "cited": false,
        "description": "July 1, 2026 — Last updated: Wednesday 1 July 2026  Summary: The best compact travel makeup mirror is not the biggest tr...",
        "domain": "lunalondon.com",
        "icon": "https:\/\/www.google.com\/s2\/favicons?domain=https:\/\/lunalondon.com\u0026sz=32",
        "position": 8,
        "title": "Compact Travel Makeup Mirror: What Actually Helps on the Go - Expert Picks",
        "url": "https:\/\/lunalondon.com\/blogs\/news\/best-compact-travel-makeup-mirror-for-on-the-go-touch-ups?utm_source=chatgpt.com"
      }
    ],
    "supporting_sources": null
  }
]
Start free
TERMINAL

Tell your agent:

Read https://brightdata.com/SKILL.md and get structured JSON for ChatGPT's answer to "Top hotels in New York" via the Web Scraper API (gd_m7aof0k82r803d5bjm): https://chatgpt.com/

Or run it yourself:

curl -H "Authorization: Bearer YOUR_API_KEY" -H "Content-Type: application/json" -d '[{"url":"https://chatgpt.com/","prompt":"Top hotels in New York","web_search":false}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_m7aof0k82r803d5bjm&format=json"

Or connect over MCP:

https://mcp.brightdata.com/mcp?token=YOUR_API_KEY
Get your token-filled URL in the control panel
For coding Agents

Plug AI scrapers into your agent

Your agent picks from AI scrapers we already maintain. Let it run whenever you need, and every run delivers real-time web data straight to your storage. Works in Claude Code, Codex, Cursor and any other coding agent.

  • Runs with npx, nothing to install
  • bdata login opens browser auth, no key to paste
  • Name a scraper, get JSON back
  • Delivers to AWS · GCP · Azure · Snowflake · Webhook
World's #1 scraping platform

Everything you need, built in

You pay for results. Proxies, rendering, concurrency, and delivery are always included, on every plan.

Go straight to the source

Every request runs on Bright Data infrastructure. 400M+ IPs, unlocking and browsers are built in.

Scale to millions of pages instantly

Send unlimited concurrent requests - no infrastructure to manage, no configs to change.

Scrapers auto-fix when sites change

AI-powered self-healing detects site changes and repairs scrapers. Your pipelines keep running.

Thousands of verified scrapers

Every scraper is built, tested, and maintained by Bright Data. No community guesswork.

Pay per result, nothing extra

One price per record . Proxies, retries, rendering, unblocking - all included, no surprises.

Compliant and fully supported

GDPR & CCPA compliant. 24/7 human support on every plan, including free.
Start free
Choose your path

Start collecting AI Web data in minutes

Call the API from code, click through the control panel, or hand it to your AI agent.
Call it from code
Trigger runs with parameters, schedule recurring jobs, and deliver to your storage or webhook.
  • Build requests in any language
  • Automate with schedulers and webhooks
  • JSON, NDJSON, or CSV delivery
Run it in the control panel
No engineering required: configure inputs, run, and download results in one place.
  • Configure inputs visually
  • Run with one click
  • Download JSON or CSV
Hand it to your agent
Your agent reads SKILL.md over MCP or the CLI and scrapes on its own.

  • Works with any MCP-compatible agent
  • One prompt to scrape
  • Structured JSON straight back to your agent
By data type

Explore more AI Web Scraper scrapers

ChatGPT Scraper API

Scrape ChatGPT search responses and the prompts behind them, with citations, attached links and recommendations.

Perplexity Scraper API

Scrape Perplexity answers with the prompts, sources and shopping data behind them.

Gemini Scraper API

Scrape Gemini answers with prompts, citations, attached links and country context.

Microsoft Copilot Scraper API

Scrape Microsoft Copilot answers with prompts, sources and citations.
Use cases

AI Web Scraper data scraping use cases

Real-time AI Web Scraper intelligence for your business.

AI visibility tracking

Prompt
Answer text
Citations
Run a prompt set on a schedule and scrape the answers to see whether your brand is named in AI answers, how it is described and which competitors appear next to it. Answers vary between runs, so only a repeated pull measures visibility rather than catching one lucky response.

Citation and source analysis

Citations
Links attached
Prompt
Scrape the citations and links behind each answer to see which domains AI engines leans on for a topic. That list is the practical target for generative engine optimisation, since being in it is what gets a brand quoted.

Competitive share of answer

Answer text
Prompt
Citations
Scrape answers across a prompt set to measure how often each vendor is recommended in a category. Tracked over time this behaves like share of search, and it usually moves before organic traffic does.

Market and regional comparison

Country
Prompt
Answer text
Scrape the same prompts across countries to see how answers and sources change by market. Regional differences in phrasing and sourcing are easy to miss by hand and often explain why a campaign lands in one market and not another.
Compare Bright Data to others

Web Scraper API vs other providers

Capability
Other scraping providers
Auto-scaling infrastructure
Unlimited
Partial
Anti-bot & CAPTCHA bypass
Built-in
Partial
Residential proxy network
400M+ IPs
Limited pool
Pre-built scrapers
1,400+
50–200
Auto-maintenance (site changes)
24/7
Depends on who built it
Pricing model
One all-in price per record
Compute, proxy, and storage metered separately
Failed requests
Free, pay only for success
Often billed
Custom sites (no pre-built scraper)
AI builds it in minutes, self-healing included
Community-built scrapers, no SLA
Compliance (GDPR, CCPA, SOC 2)
Full
Partial
Structured output (JSON/CSV)
Automatic
Support
24/7 experts, even on the free tier
Community forum
Free tier
5K records/mo
Varies
compliance

Leading the way in ethical web data collection

Only publicly available data. ISO 27001 certified, SOC 2 controls, GDPR & CCPA compliant. Every use case is reviewed by a dedicated Compliance & Ethics team, backed by a documented Know Your Customer process and Acceptable Use Policy.



Visit the trust center
Bright Data is used by world's top brands
Elio Narciso
Co-founder and CEO at ScaleStack
Jessica Zizzamia
Head of Product at Vibeslist
Arjun Chintapalli
Co-Founder & CTO of RTRVR
TJ Richardson
Co-founder at Fundable
Saroop Bharwani
Co-founder at Senso
Constantine Janashvilli
Co-founder at Parallax Vision
Bhavani Kalisetty
Co-Founder & CTO of RTRVR

AI Web Scraper API FAQs

The AI Web Scraper API is a powerful tool designed to automate data extraction from the AI Web website, allowing users to efficiently gather and process large volumes of data for various use cases.

The AI Web Scraper API works by sending automated requests to targeted website, extracting the necessary data points, and delivering them in a structured format. This process ensures accurate and quick data collection.

Yes, the AI Web Scraper API is designed to comply with data protection regulations, including GDPR and CCPA. It ensures that all data collection activities are performed ethically and legally.

Absolutely! The AI Web Scraper API is ideal for competitive analysis, allowing you to gather insights into your competitors' activities, trends, and strategies.

The AI Web Scraper API offers flawless integration with various platforms and tools. You can use it with your existing data pipelines, CRM systems, or analytics tools to improve your data processing capabilities.

Yes! Every new Bright Data account automatically includes 5,000 free credits per month (approximately $7.50 in value) — no credit card required, no promo code, no commitment. These credits apply to Scrapers (including the AI Web Scraper API), as well as the Unlocker API and SERP API. Credits renew on the 1st of each month, and you can start making API calls immediately after signing up.

When your 5,000 free monthly credits are exhausted, behavior depends on your account balance. If you have pre-deposited funds, usage continues seamlessly at standard PAYG rates with no interruption. If you have no deposited funds, requests will return an error until you add funds or until your credits renew on the 1st of the following month. Note that unused free credits do not roll over.

To avoid interruptions, you can enable auto-recharge in your billing settings at brightdata.com/cp/billing/settings.

There are no specific usage limits for the AI Web Scraper API, offering you the flexibility to scale as needed.

Yes, we offer dedicated support for the AI Web Scraper API. Our support team is available 24/7 to assist you with any questions or issues you may encounter while using the API.

Amazon S3, Google Cloud Storage, Google PubSub, Microsoft Azure Storage, Snowflake, and SFTP.

JSON, NDJSON, JSON lines, CSV, and .gz files (compressed).

Yes. Connect any agent through the hosted MCP server, point a coding agent at brightdata.com/SKILL.md to set itself up, or use the CLI. Agents authenticate once with browser OAuth and can run any of the AI Web scrapers.

The easiest way to scrape AI Web data at scale

Start free Contact sales