--- title: "Twitter" slug: twitter date: 2026-09-02T06:47:46+00:00 modified: 2026-10-14T17:15:33+00:00 permalink: https://brightdata.com/solutions/web-crawler/twitter type: page --- [Web Crawler](#anc_marketp) [Crawler Marketplace](#anc_marketp) [Pricing](#anc_price) [Code Examples](#anc_code) [Compliance](#anc_compliance) [![4.6 out of five star rating on Trustpilot](https://brightdata.com/wp-content/themes/brightdata/assets/images/social/tp_short_dark.svg?ver=16052024)](https://www.trustpilot.com/review/brightdata.com "4.6 out of five star rating on Trustpilot")[![4.7 out of 5 stars rating on G2](https://brightdata.com/wp-content/themes/brightdata/assets/images/social/g2_short_dark.svg?ver=16052024)](https://www.g2.com/products/bright-data/reviews "4.7 out of 5 stars rating on G2")[![4.8 out of 5 stars rating on Capterra](https://brightdata.com/wp-content/themes/brightdata/assets/images/social/capterra_short_dark.svg?ver=16052024)](https://www.capterra.com/p/208755/Bright-Data "4.8 out of 5 stars rating on Capterra") # Twitter Crawler Crawl X (formerly Twitter) at scale across posts and profiles. Collect public data such as post ID, author, post text, date posted, photos, quoted posts, profile name, biography, verification status, and much more. Contact salesStart free ![twitter_scrapers_hero](https://media.brightdata.com/2024/05/twitter_scrapers_hero.svg) 4 scrapers - Free tier - 5K records a month for free - Scrape on demand via API or no-code scraper - Pay only for successfully delivered results - Bulk request handling, up to 5K URLs ## Trusted by 50,000+ customers worldwide Web Scrapers ## Available Twitter crawlers Remove the need to develop and maintain the infrastructure. Simply extract high volume Twitter web data, and ensure scalability and reliability using Twitter web scraper APIs or Twitter no-code scrapers. ### X (formerly Twitter) - Posts ID, User posted, Name, Description, Date posted, Photos, URL, Quoted post, and more. 11K+ 1.2K+ Start now ### X (formerly Twitter) - Posts - Collecting Twitter posts URLs ID, User posted, Name, Description, Date posted, Photos, URL, Quoted post, and more. 11K+ 1.2K+ Start now ### X (formerly Twitter) - Profiles X id, URL, ID, Profile name, Biography, Is verified, Profile image link, External link, and more. 3.6K+ 232+ Start now ### X (formerly Twitter) - Profiles - Collect profile information by user name X id, URL, ID, Profile name, Biography, Is verified, Profile image link, External link, and more. 3.6K+ 232+ Start now AI Scraper Studio Generate a scraper API for your domain using AI [Start now](/cp/data_collector/collectors/create?camp=plg) Just want Twitter data? Skip crawling. Purchase a [Twitter dataset](/products/datasets/twitter) Pricing ## Twitter Crawler Pricing ## Only pay for what’s successfully delivered. No hidden fees, no charges for failed deliveries. Get 25% off on Scraper API for 3 months. Use code APIS25 at checkout. Start now CALCULATE YOUR COST Records per month: **5K** $/mo $ per 1,000 records Your whole bill. Proxies, unblocking, parsing included. Get started 5K 10K 50K 100K 500K 1M 5M - Pay only for success, no hidden fees - Start free with 5,000 monthly credits - No upfront commitment, cancel anytime - 24/7 expert support and enterprise features Free Tier 5K records Start free - 5K records per month - No credit card required - Expert support Pay as you go $1.5/1K record Start free - Pay only for success - Set monthly spend limits - Unlimited concurrency - Expert support Scale $499 /month Start free - 384,000 records included - $1.3/1K additional records - Unlimited concurrency - Cancel anytime - Expert support Enterprise Custom Talk to sales - Volume discounts - Account manager - Premium SLA - Priority support - SSO Comparing scraping platforms? See what others charge extra for Most platforms stack extra charges on top of the per-record rate. With Bright Data, the record price is the whole bill: Compute / runtime units commonly billed per scraper runtime hour or compute unit Included Residential proxy bandwidth commonly billed per GB Included Storage & dataset retention commonly billed per GB-month Included Data transfer / egress commonly billed per GB out Included Unblocking & CAPTCHA solving commonly a paid add-on Included Parsing to structured JSON commonly your own code Included We accept these payment methods: ## CODE EXAMPLES ## Easily crawl Twitter data without worrying about being blocked. X (formerly Twitter) - PostsX (formerly Twitter) - Profiles Scraper API Call cURL Python Node.js ``` curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://x.com/FabrizioRomano/status/1683559267524136962","country":""},{"url":"https://x.com/FabrizioRomano/status/1552015619251634176","country":""},{"url":"https://x.com/FabrizioRomano/status/1665296716721946625","country":""},{"url":"https://x.com/CNN/status/1796673270344810776","country":""},{"url":"https://x.com/elonmusk/status/1587911540770222081","country":""}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lwxkxvnf1cynvib9co&format=json&uncompressed_webhook=true" ``` ``` import requests import json headers = { "Authorization": "Bearer API_TOKEN", "Content-Type": "application/json", } payload = [{"url":"https://x.com/FabrizioRomano/status/1683559267524136962","country":""},{"url":"https://x.com/FabrizioRomano/status/1552015619251634176","country":""},{"url":"https://x.com/FabrizioRomano/status/1665296716721946625","country":""},{"url":"https://x.com/CNN/status/1796673270344810776","country":""},{"url":"https://x.com/elonmusk/status/1587911540770222081","country":""}] response = requests.post( "https://api.brightdata.com/datasets/v3/trigger" "?dataset_id=gd_lwxkxvnf1cynvib9co&format=json&uncompressed_webhook=true", headers=headers, json=payload, ) print(response.json()) ``` ``` const response = await fetch( "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lwxkxvnf1cynvib9co&format=json&uncompressed_webhook=true", { method: "POST", headers: { "Authorization": "Bearer API_TOKEN", "Content-Type": "application/json", }, body: JSON.stringify([{"url":"https://x.com/FabrizioRomano/status/1683559267524136962","country":""},{"url":"https://x.com/FabrizioRomano/status/1552015619251634176","country":""},{"url":"https://x.com/FabrizioRomano/status/1665296716721946625","country":""},{"url":"https://x.com/CNN/status/1796673270344810776","country":""},{"url":"https://x.com/elonmusk/status/1587911540770222081","country":""}]), } ); const data = await response.json(); console.log(data); ``` Response payload ``` [ { "timestamp": "2026-10-08", "id": "2032821416987427090", "user_posted": "OHL***en", "name": "OH L****n", "description": "📋 Our Line-up...\n\n#ohleuven #CHAOHL", "date_posted": "2026-03-14T14:09:28.000Z", "photos": [ "https:\/\/pbs.twimg.com\/media\/HDYITnMWAAAskUn.jpg" ], "url": "https:\/\/x.com\/OHLeuven\/status\/2032821416987427090" }, { "timestamp": "2026-10-08", "id": "2069466524276916302", "user_posted": "dal***mav***", "name": "Dallas M*******s", "description": "Looking back at some elite draft night drip 🤩 \n\n#MFFL \/\/ #NBADraft26", "date_posted": "2026-06-23T17:04:02.000Z", "photos": [ "https:\/\/pbs.twimg.com\/media\/HLg41ZHWIAAJ8fm.jpg", "https:\/\/pbs.twimg.com\/media\/HLg41ZSXMAAI8qS.jpg", "https:\/\/pbs.twimg.com\/media\/HLg41ZLWsAQAobI.jpg" ], "url": "https:\/\/twitter.com\/22185437\/status\/2069466524276916302" }, { "timestamp": "2026-10-08", "id": "2055632222925807641", "user_posted": "Sco***ren***", "name": "Scout A***a", "description": "@WhoScored Erling Haaland is the best-rated player according to our data too 🇳🇴", "date_posted": "2026-05-16T12:51:28.000Z", "photos": [ "https:\/\/pbs.twimg.com\/media\/HIcSitNWMAAK7j8.jpg" ], "url": "https:\/\/x.com\/2046853359789846528\/status\/2055632222925807641" }, { "timestamp": "2026-10-08", "id": "2068415316254970204", "user_posted": "Cul***eCr***", "name": "Cul***e C***e ***", "description": "Requirements for Xbox and Steam were also revealed\n\nFull details here: \n", "date_posted": "2026-06-20T19:26:55.000Z", "photos": null, "url": "https:\/\/twitter.com\/1115495508519182336\/status\/2068415316254970204" }, { "timestamp": "2026-10-08", "id": "1868403422782996862", "user_posted": "Che***aFa***and***", "name": "Best S****s", "description": "Back in #PL action as we host Brentford. 🔵✊\n\n#CFC | #CHEBRE", "date_posted": "2024-12-15T21:11:03.000Z", "photos": [ "https:\/\/pbs.twimg.com\/media\/GetKbm6XAAAnxfF.jpg" ], "url": "https:\/\/x.com\/ChelseaFanStand\/status\/1868403422782996862" } ] ``` Scraper API Call cURL Python Node.js ``` curl -H "Authorization: Bearer API_TOKEN" -H "Content-Type: application/json" -d '[{"url":"https://x.com/elonmusk","max_number_of_posts":100},{"url":"https://x.com/cnn","max_number_of_posts":20},{"url":"https://x.com/BillGates","max_number_of_posts":35},{"url":"https://x.com/fabrizioromano","max_number_of_posts":10}]' "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lwxmeb2u1cniijd7t4&format=json&uncompressed_webhook=true" ``` ``` import requests import json headers = { "Authorization": "Bearer API_TOKEN", "Content-Type": "application/json", } payload = [{"url":"https://x.com/elonmusk","max_number_of_posts":100},{"url":"https://x.com/cnn","max_number_of_posts":20},{"url":"https://x.com/BillGates","max_number_of_posts":35},{"url":"https://x.com/fabrizioromano","max_number_of_posts":10}] response = requests.post( "https://api.brightdata.com/datasets/v3/trigger" "?dataset_id=gd_lwxmeb2u1cniijd7t4&format=json&uncompressed_webhook=true", headers=headers, json=payload, ) print(response.json()) ``` ``` const response = await fetch( "https://api.brightdata.com/datasets/v3/trigger?dataset_id=gd_lwxmeb2u1cniijd7t4&format=json&uncompressed_webhook=true", { method: "POST", headers: { "Authorization": "Bearer API_TOKEN", "Content-Type": "application/json", }, body: JSON.stringify([{"url":"https://x.com/elonmusk","max_number_of_posts":100},{"url":"https://x.com/cnn","max_number_of_posts":20},{"url":"https://x.com/BillGates","max_number_of_posts":35},{"url":"https://x.com/fabrizioromano","max_number_of_posts":10}]), } ); const data = await response.json(); console.log(data); ``` Response payload ``` [ { "timestamp": "2026-10-07", "x_id": "140072288", "url": "https:\/\/x.com\/huismanetech", "id": "Hui***nEt***", "profile_name": "Hui***nEt***Exp******", "biography": "In oplossingen denkende innovatieve totaalpartner in elektrotechniek.", "is_verified": false, "profile_image_link": "https:\/\/pbs.twimg.com\/profile_images\/677762831643611136\/EH6q795G_400x400.jpg" }, { "timestamp": "2026-10-07", "x_id": "979682660762247168", "url": "https:\/\/x.com\/meysu_turkiye", "id": "mey***tur***e", "profile_name": "Mey***Tür***e", "biography": "Meysu", "is_verified": true, "profile_image_link": "https:\/\/pbs.twimg.com\/profile_images\/2024811128644063232\/ViBbDjbY_400x400.png" }, { "timestamp": "2026-10-07", "x_id": "1217097399275085824", "url": "https:\/\/x.com\/lotodelsur", "id": "Lot***lsu***", "profile_name": "Loto *** ***", "biography": "#TodoElPoderDeLasPlantas\nEnvíos a toda Colombia 📦 International shipping\nThe unleashed power of plants. \nPremium Cosmet...", "is_verified": false, "profile_image_link": "https:\/\/pbs.twimg.com\/profile_images\/1220824242465447936\/fyeJoki5_400x400.jpg" }, { "timestamp": "2026-10-07", "x_id": "28370738", "url": "https:\/\/x.com\/sinow", "id": "******", "profile_name": "Sports I*********d", "biography": "2220367 followers · 3628 following. New York, NY. Joined Apr 2009. See the latest conversations with @SInow", "is_verified": true, "profile_image_link": "https:\/\/pbs.twimg.com\/profile_images\/1899547764674920448\/Dk3S45nv_400x400.jpg" }, { "timestamp": "2026-10-07", "x_id": "2609260128", "url": "https:\/\/x.com\/deltaresnl", "id": "Del***esN***", "profile_name": "Del***esN***", "biography": "Kennisinstituut voor water en ondergrond. Bodemdaling | Klimaatadaptatie | Waterveiligheid | Waterschaarste | Bouwen me...", "is_verified": false, "profile_image_link": "https:\/\/pbs.twimg.com\/profile_images\/1206882897929687040\/ZUnAcn3C_400x400.jpg" } ] ``` ## ## API for Seamless Twitter Data Access Comprehensive, Scalable, and Compliant Web Data Extraction FLEXIBLE #### Tailored to your workflow Get structured data in JSON, NDJSON, or CSV files through Webhook or API delivery. SCALABLE #### Built-in infrastructure and unblocking Get maximum control and flexibility without maintaining proxy and unblocking infrastructure. Easily scrape data from any geo-location while avoiding CAPTCHAs and blocks. STABLE #### Battle-proven infrastructure Bright Data’s platform powers 50,000+ companies worldwide, offering peace of mind with 99.99% uptime, access to 400M+ real user IPs covering 195 countries. COMPLIANT #### Industry leading compliance Our privacy practices comply with data protection laws, including the EU data protection regulatory framework, GDPR, and CCPA. ## Simplified Twitter crawling [### Twitter Hashtag Crawler Crawl Twitter hashtags and collect data such as replies, reposts, likes, views, bookmarks, description, date posted, and much more. ](/products/web-scraper/twitter/hashtag) [### Twitter Post Crawler Crawl Twitter posts and collect public data such as post ID, user posted, description, date posted, photos, and much more. ](/products/web-scraper/twitter/posts) [### Twitter Profile Crawler Crawl Twitter to collect public data specifically focusing on profiles, including user bios, tweet histories, follower counts, and engagement patterns. ](/products/web-scraper/twitter/profile) [### Twitter Image Crawler Crawl Twitter to collect public data specifically focusing on images, including image URLs, associated hashtags, user profiles, and engagement metrics. ](/products/web-scraper/twitter/image) [### Twitter Followers Crawler Crawl Twitter to collect public data specifically focusing on followers, including follower counts, user profiles, following lists, and interaction patterns. ](/products/web-scraper/twitter/followers) ## Twitter crawling use cases ### Trend discovery Crawl Twitter posts to track public conversations and emerging topics. Collect likes, reposts, replies, views, quotes, and hashtags across profiles and posts to identify shifts in user sentiment and spot trending subjects before they hit the mainstream. ### Find influencers Crawl Twitter profile data to identify the right voices to promote your brand. Analyze follower counts, tweet volume, verification status, biography, location, and post engagement metrics such as likes, reposts, and replies to find accounts with the reach and audience alignment your campaigns need. ### Monitor brand reputation Crawl Twitter posts and profile data to monitor what users are saying about your brand. Collect post text, hashtags, tagged users, reply counts, reposts, and bookmarks to measure sentiment, track how brand mentions spread, and identify areas of improvement before conversations escalate. ## Leading the way in ethical web data collection We have set the [ gold standard for ethical and compliant web data practices.](/trustcenter) Our peer network is built on trust, with every member personally opting in and the guarantee of zero personal data collection. We champion the collection of only publicly available data, backed by an industry-leading Know Your Customer process and a transparent Acceptable Use Policy. Our global, multilingual Compliance & Ethics team, the first of its kind, ensures we stay ahead of regulatory changes and best practices. ## Why 50,000+ Customers Choose Bright Data ### 100% Compliant Scraped data is ethically obtained and compliant with all privacy laws. ### 24/7 Global Support A dedicated team of data professionals is here to help. ### Complete Data Coverage Access 400 million+ global IPs to scrape data from any website. ### Unmatched Data Quality Advanced technologies and validation methods for quality data. ### Powerful Infrastructure Scrape high-volume data without getting blocked. ### Custom Solutions Get tailored solutions to meet unique needs and goals. Bright Data is used by world's top brands - [ --- Elio Narciso Co-founder and CEO at ScaleStack ](https://www.youtube.com/embed/j0BYFsK3k54) - [ --- Jessica Zizzamia Head of Product at Vibeslist ](https://www.youtube.com/embed/Qki-yHyCYt4) - [ --- Arjun Chintapalli Co-Founder & CTO of RTRVR ](https://www.youtube.com/embed/xUhRwFPIphI) - [ --- TJ Richardson Co-founder at Fundable ](https://www.youtube.com/embed/fT0ndFBQ-Vs) - [ --- Saroop Bharwani Co-founder at Senso ](https://www.youtube.com/embed/6Lo0w1hxAso) - [ --- Constantine Janashvilli Co-founder at Parallax Vision ](https://www.youtube.com/embed/vcfDCWutHyo) - [ --- Bhavani Kalisetty Co-Founder & CTO of RTRVR ](https://www.youtube.com/embed/EcBiLXl57N0) ### Twitter Crawler FAQs [### What is the Twitter crawler?](<#What is the Twitter crawler?>)The Twitter crawler is an automated tool that discovers and collects public data from Twitter at scale. You don't need a full list of URLs. You can start from a keyword, a category, a search URL or a specific page. The crawler finds the matching records and sends the data back in a structured format. [### What is the difference between crawling and scraping Twitter?](<#What is the difference between crawling and scraping Twitter?>)Crawling is about discovery: finding the pages. Scraping is about extraction: pulling specific fields from a page you already know about. A scraper needs you to tell it which URL to visit. A crawler finds the records for you and then extracts the data. Use the crawler when you don't have the full list of URLs, or when the list keeps changing, such as every item in a category or every result for a keyword. If you already have the exact URLs, collecting by URL is the more direct option. [### How is the Twitter crawler different from a Twitter dataset?](<#How is the Twitter crawler different from a Twitter dataset?>)A dataset is data that has already been collected, and you buy it as a ready-made file. The crawler collects fresh data when you run it, based on your own inputs. Pick a dataset if you want broad coverage right away with no setup. Pick the crawler if you need a specific scope, the latest data or collection on a schedule you control. [### How is the Twitter crawler different from using proxies?](<#How is the Twitter crawler different from using proxies?>)Proxies are infrastructure. They send your requests through different IP addresses, but you still have to build and maintain the crawler, the parser and the unblocking. The Twitter crawler includes all of it: proxy management, full browser rendering, CAPTCHA solving, data parsing and delivery. Choose proxies if you want to write and own the code. Choose the crawler if you just want the data. [### Is the Twitter crawler the same as Bright Data's Crawl API?](<#Is the Twitter crawler the same as Bright Data's Crawl API?>)No. The Crawl API works on any public website. You give it a root URL, and it returns the site's content as Markdown, Text, HTML or JSON. The Twitter crawler is built only for Twitter. It returns ready-to-use fields specific to Twitter, so you don't have to write your own parsing logic. [### What inputs can I use to start a crawl?](<#What inputs can I use to start a crawl?>)It depends on the crawler you choose. Common starting points are a direct URL, a keyword, a category URL, a search URL, or a profile, seller or shop URL. You can send up to 5,000 URLs in a single bulk request. [### Can I schedule recurring crawls of Twitter?](<#Can I schedule recurring crawls of Twitter?>)Yes. The crawler supports batch and scheduled collection, so you can rerun the same crawl at regular intervals. This is useful for tracking changes over time, such as prices, availability, rankings or engagement numbers, without starting each run by hand. [### Do I need to deal with blocks, CAPTCHAs or JavaScript rendering?](<#Do I need to deal with blocks, CAPTCHAs or JavaScript rendering?>)No. Proxy management, CAPTCHA solving and full browser rendering are all built in. The crawler runs on Bright Data's network of over 400 million real user IPs in 195 countries, so you can crawl Twitter from any location without maintaining your own unblocking setup. [### How is the Twitter crawler priced?](<#How is the Twitter crawler priced?>)You pay only for records that are successfully delivered. Failed deliveries are never charged. You can start on the free tier with 5,000 records a month and no credit card, then move to pay as you go or a monthly plan as you scale. Plan details are in the pricing section above. [### Is it legal to crawl Twitter?](<#Is it legal to crawl Twitter?>)The crawler only collects publicly available data. Bright Data's privacy practices follow data protection laws, including GDPR and CCPA. It also has a Know Your Customer process and a public Acceptable Use Policy. You are still responsible for making sure your own use of the data complies with the laws that apply to you. ## Want to learn more? Talk to an expert to discuss your Twitter crawling needs Contact sales