Sitemap Scraper API
Scrape any website’s XML sitemaps. Easily extract URLs from all page-type sitemaps for your data collection projects. The whole website can be crawled through the sitemap, with a lower chance of reaching 301 or 404 status code pages.
- We develop the scraper, you get the data
- Scrape on demand via API or no-code scraper
- 100% ethical and compliant scraping
- Retrieve results in
multiple formats
Trusted by 20,000+ customers worldwide
PROCESS
Sitemap scraper tailored to your needs.
-
Request Data
Select your target domains and required data points.
-
Schema Creation
AI agent analyzes your request and delivers a free tailored schema for your review.
-
Talk to a Data Expert
Discuss your data requirements and key objectives to ensure the project's success.
-
Data Collection
Start collecting data, without maintaining proxy and unblocking infrastructure.
Web Scrapers
Ready-to-use related scrapers
Remove the need to develop and maintain the infrastructure. Simply extract high volume web data, and ensure scalability and reliability using web scraper APIs or no-code scrapers.
LinkedIn people profiles
ID, Name, City, Country code, Position, About, Posts, Current company, and more.
4.2K+LinkedIn people profiles - Discover LinkedIn profiles by name
ID, Name, City, Country code, Position, About, Posts, Current company, and more.
Amazon products
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products - Collects products by best sellers category URL
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products - Collects products by specific category URL
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products - Collects products by specific keywords
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products - find products by using upc numbers
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
LinkedIn company information
ID, Name, Country code, Locations, Followers, Employees in linkedin, About, Specialties, and more.
Instagram - Profiles
Account, Fbid, ID, Followers, Posts count, Is business account, Is professional account, Is verified, and more.
Crunchbase companies information
Name, URL, ID, Cb rank, Region, About, Industries, Operating status, and more.
Crunchbase companies information - Searching data by keyword
Name, URL, ID, Cb rank, Region, About, Industries, Operating status, and more.
Linkedin job listings information
URL, Job posting id, Job title, Company name, Company id, Job location, Job summary, Job seniority level, and more.
Linkedin job listings information - Discover new jobs by keyword
URL, Job posting id, Job title, Company name, Company id, Job location, Job summary, Job seniority level, and more.
Linkedin job listings information - Discover jobs by company URL
URL, Job posting id, Job title, Company name, Company id, Job location, Job summary, Job seniority level, and more.
Zillow properties listing information
Zpid, City, State, HomeStatus, Address, IsListingClaimedByCurrentSignedInUser, IsCurrentSignedInAgentResponsible, Bedrooms, and more.
Zillow properties listing information - Discover by custom filters - location, home type and status
Zpid, City, State, HomeStatus, Address, IsListingClaimedByCurrentSignedInUser, IsCurrentSignedInAgentResponsible, Bedrooms, and more.
Zillow properties listing information - Search by parameters on zillow and use the direct link as input
Zpid, City, State, HomeStatus, Address, IsListingClaimedByCurrentSignedInUser, IsCurrentSignedInAgentResponsible, Bedrooms, and more.
Instagram - Posts
URL, User posted, Description, Hashtags, Num comments, Date posted, Likes, Photos, and more.
Instagram - Posts - Collects posts from a specific URLs by using profile URL
URL, User posted, Description, Hashtags, Num comments, Date posted, Likes, Photos, and more.
X (formerly Twitter) - Posts
ID, User posted, Name, Description, Date posted, Photos, URL, Quoted post, and more.
X (formerly Twitter) - Posts - Collecting Twitter posts URLs
ID, User posted, Name, Description, Date posted, Photos, URL, Quoted post, and more.
LinkedIn posts
URL, ID, User id, Use url, Title, Headline, Post text, Date posted, and more.
LinkedIn posts - Discover user's articles by URL
URL, ID, User id, Use url, Title, Headline, Post text, Date posted, and more.
LinkedIn posts - Discover posts by Profile URL
URL, ID, User id, Use url, Title, Headline, Post text, Date posted, and more.
LinkedIn posts - Discover new posts company URL
URL, ID, User id, Use url, Title, Headline, Post text, Date posted, and more.
TikTok - Profiles
Account id, Nickname, Biography, Awg engagement rate, Comment engagement rate, Like engagement rate, Bio link, Predicted lang, and more.
TikTok - Profiles - Discover by search URL and country
Account id, Nickname, Biography, Awg engagement rate, Comment engagement rate, Like engagement rate, Bio link, Predicted lang, and more.
Facebook - Pages Posts by Profile URL
URL, Post id, User url, User username raw, Content, Date posted, Hashtags, Num comments, and more.
Amazon Reviews
URL, Product name, Product rating, Product rating object, Product rating max, Rating, Author name, Asin, and more.
Walmart - products
URL, Final price, Sku, Currency, Gtin, Specifications, Image urls, Top reviews, and more.
Walmart - products - Find new products by using specific category URL
URL, Final price, Sku, Currency, Gtin, Specifications, Image urls, Top reviews, and more.
Walmart - products - Collects products by specific keywords
URL, Final price, Sku, Currency, Gtin, Specifications, Image urls, Top reviews, and more.
Walmart - products - Discover products by using sku numbers
URL, Final price, Sku, Currency, Gtin, Specifications, Image urls, Top reviews, and more.
Indeed job listings information
Jobid, Company name, Date posted parsed, Job title, Description text, Benefits, Qualifications, Job type, and more.
Indeed job listings information - Collect new jobs by keyword search in specific location
Jobid, Company name, Date posted parsed, Job title, Description text, Benefits, Qualifications, Job type, and more.
Indeed job listings information - Discover jobs by company URL
Jobid, Company name, Date posted parsed, Job title, Description text, Benefits, Qualifications, Job type, and more.
TikTok - Posts
URL, Post id, Description, Create time, Digg count, Share count, Collect count, Comment count, and more.
TikTok - Posts - Input specific profile URL to get posts published by it
URL, Post id, Description, Create time, Digg count, Share count, Collect count, Comment count, and more.
TikTok - Posts - Search posts by specific keyword or hashtag
URL, Post id, Description, Create time, Digg count, Share count, Collect count, Comment count, and more.
TikTok - Posts - discover new records by TikTok discover URL
URL, Post id, Description, Create time, Digg count, Share count, Collect count, Comment count, and more.
Youtube - Videos posts
URL, Title, Youtuber, Youtuber md5, Video url, Video length, Likes, Views, and more.
Youtube - Videos posts - Search new youtube videos by keyword
URL, Title, Youtuber, Youtuber md5, Video url, Video length, Likes, Views, and more.
Youtube - Videos posts - Discover videos by channel URL
URL, Title, Youtuber, Youtuber md5, Video url, Video length, Likes, Views, and more.
Youtube - Videos posts - Search videos by keyword and then apply relevant video filters
URL, Title, Youtuber, Youtuber md5, Video url, Video length, Likes, Views, and more.
Youtube - Videos posts - Collect YouTube posts by hashtags
URL, Title, Youtuber, Youtuber md5, Video url, Video length, Likes, Views, and more.
YouTube - Profiles
URL, Handle, Handle md5, Banner img, Profile image, Name, Subscribers, Description, and more.
YouTube - Profiles - Collects channel by keyword related to the channel or video's of the channel
URL, Handle, Handle md5, Banner img, Profile image, Name, Subscribers, Description, and more.
Airbnb Properties Information
Name, Price, Image, Description, Category, Availability, Discount, Reviews, and more.
Airbnb Properties Information - Search Airbnb by location
Name, Price, Image, Description, Category, Availability, Discount, Reviews, and more.
Airbnb Properties Information - Discover by search url
Name, Price, Image, Description, Category, Availability, Discount, Reviews, and more.
Glassdoor companies overview information
ID, Company, Ratings overall, Details size, Details founded, Details type, Country code, Company type, and more.
Glassdoor companies overview information - Search for companies by keyword
ID, Company, Ratings overall, Details size, Details founded, Details type, Country code, Company type, and more.
Glassdoor companies overview information - discover new companies by input filters
ID, Company, Ratings overall, Details size, Details founded, Details type, Country code, Company type, and more.
Glassdoor companies overview information - discover by search url
ID, Company, Ratings overall, Details size, Details founded, Details type, Country code, Company type, and more.
X (formerly Twitter) - Profiles
X id, URL, ID, Profile name, Biography, Is verified, Profile image link, External link, and more.
Yahoo Finance business information
Name, Company id, Entity type, Summary, Stock ticker, Currency, Earnings date, Exchange, and more.
Yahoo Finance business information - Discover records by keyword
Name, Company id, Entity type, Summary, Stock ticker, Currency, Earnings date, Exchange, and more.
TikTok Shop
URL, Title, Available, Description, Currency, Initial price, Final price, Discount percent, and more.
TikTok Shop - category
URL, Title, Available, Description, Currency, Initial price, Final price, Discount percent, and more.
Google News
URL, Title, Publisher, Date, Category, Keyword, Country, Image, and more.
Facebook - Comments
URL, Post id, Post url, Comment id, User name, User id, User url, Date created, and more.
Booking Hotel Listings
URL, Hotel id, Title, Location, Country, City, Metro railway access, Images, and more.
Booking Hotel Listings -
URL, Hotel id, Title, Location, Country, City, Metro railway access, Images, and more.
Instagram - Reels
URL, User posted, Description, Hashtags, Num comments, Date posted, Likes, Views, and more.
Instagram - Reels - Discover reels video from Instagram profile or direct search url
URL, User posted, Description, Hashtags, Num comments, Date posted, Likes, Views, and more.
Instagram - Reels - Collect all Reels from Instagram profiles (without the post timestamp)
URL, User posted, Description, Hashtags, Num comments, Date posted, Likes, Views, and more.
Yelp businesses overview
Business id, Yelp biz id, Name, Updates from business, Overall rating, Reviews count, Is claimed, Categories, and more.
Yelp businesses overview - Collect Yelp businesses by url
Business id, Yelp biz id, Name, Updates from business, Overall rating, Reviews count, Is claimed, Categories, and more.
Google maps reviews
URL, Place id, Place name, Country, Address, Review id, Reviewer name, Reviews by reviewer, and more.
Instagram - Comments
URL, Comment user, Comment user url, Comment date, Comment, Likes number, Replies number, Replies, and more.
Glassdoor job listings information
URL, Company url overview, Company name, Company rating, Job title, Job location, Job overview, Company headquarters, and more.
Glassdoor job listings information - Collect new jobs by keyword search like the job title
URL, Company url overview, Company name, Company rating, Job title, Job location, Job overview, Company headquarters, and more.
Glassdoor job listings information - Discover jobs by company URL
URL, Company url overview, Company name, Company rating, Job title, Job location, Job overview, Company headquarters, and more.
Glassdoor companies reviews
Overview id, Review id, Review url, Rating date, Count helpful, Count unhelpful, Employee job end year, Employee length, and more.
Reddit- Posts
Post id, URL, User posted, Title, Description, Num comments, Date posted, Community name, and more.
Reddit- Posts - Discover Reddit posts by Subreddit URL
Post id, URL, User posted, Title, Description, Num comments, Date posted, Community name, and more.
Reddit- Posts - Discovery by keyword of Reddit posts
Post id, URL, User posted, Title, Description, Num comments, Date posted, Community name, and more.
Zoominfo companies information
URL, ID, Name, Description, Revenue, Revenue currency, Revenue text, Stock symbol, and more.
Zoominfo companies information - discover records by search url
URL, ID, Name, Description, Revenue, Revenue currency, Revenue text, Stock symbol, and more.
Amazon products global dataset
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products global dataset - Collects products by specific category URL
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products global dataset - Collecting products by keyword search
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products global dataset - Collect Amazon products by seller URL
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
Amazon products global dataset - Collect products from Brands URLs
Title, Seller name, Brand, Description, Initial price, Currency, Availability, Reviews count, and more.
pitchbook companies information
URL, ID, Company name, Company socials, Year founded, Status, Employees, Latest deal type, and more.
Amazon sellers info
Seller id, URL, Seller name, Description, Detailed info, Stars, Feedbacks, Return policy, and more.
eBay
URL, Product id, Title, Seller name, Seller rating, Seller reviews, Breadcrumbs, Root category, and more.
eBay - Gather data on products using specified keywords
URL, Product id, Title, Seller name, Seller rating, Seller reviews, Breadcrumbs, Root category, and more.
eBay - Collect products from shops on eBay
URL, Product id, Title, Seller name, Seller rating, Seller reviews, Breadcrumbs, Root category, and more.
Google Shopping
URL, Product id, Title, Product description, Rating, Reviews count, Images, Variations, and more.
Google Shopping - collects products from web using keywords
URL, Product id, Title, Product description, Rating, Reviews count, Images, Variations, and more.
Github repository
URL, ID, Code language, Code, Num lines, User name, User url, Size, and more.
Github repository - Discover github code by repository URL
URL, ID, Code language, Code, Num lines, User name, User url, Size, and more.
Github repository - discover new records by search url
URL, ID, Code language, Code, Num lines, User name, User url, Size, and more.
Australia real estate properties
Rea property id, Property type, State, Postcode, Year built, Last sold date, Last sold agency, Bedrooms, and more.
Australia real estate properties - discover records by search url
Rea property id, Property type, State, Postcode, Year built, Last sold date, Last sold agency, Bedrooms, and more.
Australia real estate properties - Discover records by Listing type
Rea property id, Property type, State, Postcode, Year built, Last sold date, Last sold agency, Bedrooms, and more.
Facebook - Posts by group URL
URL, Post id, User url, User username raw, Content, Date posted, Hashtags, Num comments, and more.
Google Play Store
URL, Title, Developer, Monetization features, Images, About, Data safety, Rating, and more.
Facebook Marketplace
URL, Title, Initial price, Final price, Currency, Product id, Breadcrumbs, Condition, and more.
Facebook Marketplace - Collect Facebook marketplace listings by keyword
URL, Title, Initial price, Final price, Currency, Product id, Breadcrumbs, Condition, and more.
Facebook Marketplace - discover by url
URL, Title, Initial price, Final price, Currency, Product id, Breadcrumbs, Condition, and more.
Home Depot US
URL, Domain, Country code, Model number, Sku, Product id, Product name, Manufacturer, and more.
Home Depot US - Gather data on products using specified keywords
URL, Domain, Country code, Model number, Sku, Product id, Product name, Manufacturer, and more.
Home Depot US - Discover products by specified URL
URL, Domain, Country code, Model number, Sku, Product id, Product name, Manufacturer, and more.
Home Depot US - Discover products by specified UPC
URL, Domain, Country code, Model number, Sku, Product id, Product name, Manufacturer, and more.
Home Depot US - Discovery products by specific category URL
URL, Domain, Country code, Model number, Sku, Product id, Product name, Manufacturer, and more.
TikTok - Comments
URL, Post url, Post id, Post date created, Date created, Comment text, Num likes, Num replies, and more.
Facebook - Posts by post URL
URL, Post id, User url, User username raw, Content, Date posted, Hashtags, Num comments, and more.
Booking Listings Search
URL, Location, Check in, Check out, Adults, Children, Rooms, ID, and more.
G2 software - product reviews
Review id, Author id, Author, Position, Company size, Stars, Date, Title, and more.
Amazon products search
Asin, URL, Name, Sponsored, Initial price, Final price, Currency, Sold, and more.
Etsy
URL, Product id, Listing inventory id, Title, Rating, Reviews count shop, Reviews count item, Initial price, and more.
Etsy - Collect data on products using specified keywords
URL, Product id, Listing inventory id, Title, Rating, Reviews count shop, Reviews count item, Initial price, and more.
Etsy - Collects data from shop's URL
URL, Product id, Listing inventory id, Title, Rating, Reviews count shop, Reviews count item, Initial price, and more.
Zara - Products
Category id, Product id, Product name, Price, Currency, Colour code, Colour, Description, and more.
Zara - Products - discovery by category url
Category id, Product id, Product name, Price, Currency, Colour code, Colour, Description, and more.
Trustpilot business reviews
Company name, Review id, Review date, Review rating, Review title, Review content, Is verified review, Review date of experience, and more.
Yelp businesses reviews
Business id, Review auther, Rating, Date, Content, Review image, Reactions, Replies, and more.
Yelp businesses reviews - Search for Yelp businesses by country, category and location
Business id, Review auther, Rating, Date, Content, Review image, Reactions, Replies, and more.
Zillow price history
URL, Zpid, Date, Event, Posting is rental, Price, Price change rate, Price per squarefoot, and more.
Indeed companies info
Name, Description, URL, Work happiness, Jobs categories, Website, Industry, Company size, and more.
Indeed companies info - By company list
Name, Description, URL, Work happiness, Jobs categories, Website, Industry, Company size, and more.
Indeed companies info - Discover companies by Industries and location (State) in US
Name, Description, URL, Work happiness, Jobs categories, Website, Industry, Company size, and more.
Indeed companies info - Search company by company name
Name, Description, URL, Work happiness, Jobs categories, Website, Industry, Company size, and more.
Zoopla properties listing information
URL, Property type, Property title, Address, Google map location, Virtual tour, Street view, URL property, and more.
Zoopla properties listing information - Discover by custom filters - location and property type
URL, Property type, Property title, Address, Google map location, Virtual tour, Street view, URL property, and more.
Ikea - Products
Description, In stock, Color, Size, Reviews count, Main image, Category url, Category, and more.
Ikea - Products - Discovery new products by category URL
Description, In stock, Color, Size, Reviews count, Main image, Category url, Category, and more.
Best Buy products
URL, Product id, Title, Images, Final price, Currency, Discount, Initial price, and more.
Best Buy products - Collect data on products using specified keywords
URL, Product id, Title, Images, Final price, Currency, Discount, Initial price, and more.
Lazada - Products
URL, Title, Rating, Reviews, Initial price, Final price, Currency, Stock, and more.
Lazada - Products - Discover products by keyword
URL, Title, Rating, Reviews, Initial price, Final price, Currency, Stock, and more.
Lazada - Products - Discover products by category URL or brand URL
URL, Title, Rating, Reviews, Initial price, Final price, Currency, Stock, and more.
Lazada - Products - Discover products by seller URL
URL, Title, Rating, Reviews, Initial price, Final price, Currency, Stock, and more.
Lazada - Products - Discover products by brand URL
URL, Title, Rating, Reviews, Initial price, Final price, Currency, Stock, and more.
Pitchbook People Profiles
URL, ID, Name, Biography, Primary position, Commpany, Company url, Education, and more.
Target
URL, Product id, Title, Product description, Rating, Reviews count, Initial price, Discount, and more.
Target - Gather data on products using specified keywords
URL, Product id, Title, Product description, Rating, Reviews count, Initial price, Discount, and more.
Target - Discover products by specified URL
URL, Product id, Title, Product description, Rating, Reviews count, Initial price, Discount, and more.
Target - Discover products by specified UPC
URL, Product id, Title, Product description, Rating, Reviews count, Initial price, Discount, and more.
Reddit - Comments
URL, Comment id, User posted, Comment, Date posted, Post url, Post id, Community name, and more.
Ozon.ru products
URL, Sku, Breadcrumbs, Name, Rating, Review count, Description, Image, and more.
Youtube - Comments
Comment id, Comment text, Likes, Replies, Username, Username md5, User channel, Date, and more.
Myntra products
URL, Product id, Title, Product description, Rating, Ratings count, Initial price, Discount, and more.
Myntra products - Collect products by category URL
URL, Product id, Title, Product description, Rating, Ratings count, Initial price, Discount, and more.
Myntra products - Collect products by keyword
URL, Product id, Title, Product description, Rating, Ratings count, Initial price, Discount, and more.
Myntra products - Collect products by brand URL
URL, Product id, Title, Product description, Rating, Ratings count, Initial price, Discount, and more.
Sephora products
URL, ID, Name, Sku, In stock, Regular price, Actual price, Unit price, and more.
Wikipedia articles
URL, Title, Table of contents, Raw text, Cataloged text, Images, See also, References, and more.
Wikipedia articles - Discover new articles by searching keywords in Wikipedia
URL, Title, Table of contents, Raw text, Cataloged text, Images, See also, References, and more.
OLX Brazil - marketplace ads
Body, Subject, Currency, PriceValue, ProfessionalAnnouncement, Category, ParentCategoryName, CategoryName, and more.
BBC news
ID, URL, Author, Headline, Topics, Publication date, Content, Videos, and more.
BBC news - Discover BBC articles by keyword
ID, URL, Author, Headline, Topics, Publication date, Content, Videos, and more.
Google Play Store reviews
URL, Review id, Reviewer name, Review date, Review rating, Review, Found helpful, App url, and more.
Pinterest - Posts
URL, Post id, Title, Content, Date posted, User name, User url, User id, and more.
Pinterest - Posts - Collects posts by specific keywords
URL, Post id, Title, Content, Date posted, User name, User url, User id, and more.
Pinterest - Posts - Discover posts by using specific profile url
URL, Post id, Title, Content, Date posted, User name, User url, User id, and more.
Realtor international properties listings
URL, ID, Title, Price, Currency, Description, Images, Bedrooms, and more.
Realtor international properties listings - Discover records by filter url
URL, ID, Title, Price, Currency, Description, Images, Bedrooms, and more.
Realtor international properties listings - Discovery new records by filter
URL, ID, Title, Price, Currency, Description, Images, Bedrooms, and more.
Facebook - Reels by profile URL
URL, Post id, User url, User username raw, Content, Date posted, Hashtags, Num comments, and more.
H&M - Products
Category tree, Color, Country code, County of origin, Currency, Delivery, Description, Domain, and more.
H&M - Products - Discovery new products by category URL
Category tree, Color, Country code, County of origin, Currency, Delivery, Description, Domain, and more.
Owler companies information
CompanyID, Ownership, IndustrySectors, Revenue, Founded, CompanyName, Country, EmployeeCount, and more.
Facebook Company Reviews
Company name, Company id, Company url, URL, Review time, Recommends, Review content, Review attachments, and more.
Facebook Events
Event id, URL, Main image, Event date, Title, People responded, Event by, Location, and more.
Facebook Events - discover Facebook events search URL
Event id, URL, Main image, Event date, Title, People responded, Event by, Location, and more.
Facebook Events - Discover events by venue URL
Event id, URL, Main image, Event date, Title, People responded, Event by, Location, and more.
Xing social network
Account id, FamilyName, Gender, Membership, Country code, Experience, Education, Languages, and more.
US lawyers directory
URL, Address, Admission, Areas of practice, Isln, Law school attended, Location, Name, and more.
US lawyers directory - Search on the website by attorney name, practice area, school, articles, or location
URL, Address, Admission, Areas of practice, Isln, Law school attended, Location, Name, and more.
Webmotors Brasil - Cars Listings
ID SELLER, ID, URL, Tipo, Marca, Modelo, Ano, Variante, and more.
Webmotors Brasil - Cars Listings - Discover new records by category URL
ID SELLER, ID, URL, Tipo, Marca, Modelo, Ano, Variante, and more.
Lowes.com
URL, Domain, Marketplace pn, Sku, Other pn, Model number, Gtin ean pn, Product name, and more.
Lowes.com - Gather data on products using specified keywords
URL, Domain, Marketplace pn, Sku, Other pn, Model number, Gtin ean pn, Product name, and more.
Digikey - Products
Product url, Category url, Part number, Description, Manufacturer, Manufacturer url, Datasheet url, Rohs compliant, and more.
Digikey - Products - Discover by category url
Product url, Category url, Part number, Description, Manufacturer, Manufacturer url, Datasheet url, Rohs compliant, and more.
Google Shopping products search US
URL, Product id, Title, Final price, Initial price, Currency, Rating, Reviews count, and more.
Wildberries.ru products
URL, Sku, Breadcrumbs, Name, Rating, Review count, Image, Brand, and more.
Zonaprop Argentina - Properties Listing
URL, Title, GeneratedTitle, Imagenes, Numero de imagenes, Description, Precio, Currency, and more.
Zonaprop Argentina - Properties Listing - Discover products by domain
URL, Title, GeneratedTitle, Imagenes, Numero de imagenes, Description, Precio, Currency, and more.
CNN news
ID, URL, Author, Headline, Topics, Publication date, Updated last, Content, and more.
CNN news - Discover CNN articles by search URL
ID, URL, Author, Headline, Topics, Publication date, Updated last, Content, and more.
CNN news - Discovery article by the publishing date and time
ID, URL, Author, Headline, Topics, Publication date, Updated last, Content, and more.
Tokopedia Products
Product id, Title, URL, Currency, Delivery, Final price, Initial price, Seller name, and more.
Tokopedia Products - Search products by keyword
Product id, Title, URL, Currency, Delivery, Final price, Initial price, Seller name, and more.
Tokopedia Products - Collect URLs of products by category URLs
Product id, Title, URL, Currency, Delivery, Final price, Initial price, Seller name, and more.
Tokopedia Products - Collect Tokopedia's products by seller URL
Product id, Title, URL, Currency, Delivery, Final price, Initial price, Seller name, and more.
Walmart sellers info
Seller id, URL, Catalog seller id, Seller name, Seller display name, Seller email, Seller phone, Seller about us, and more.
Wayfair products
URL, Product id, Title, Rating, Reviews count, Initial price, Discount, Final price, and more.
Wayfair products - Gather data on products using specified keywords
URL, Product id, Title, Rating, Reviews count, Initial price, Discount, Final price, and more.
Wayfair products - discover records by category url
URL, Product id, Title, Rating, Reviews count, Initial price, Discount, Final price, and more.
Mouser - Products
Product url, Category url, Mouser part num, Mfr part number, Manufacturer, Image, Image high, Manufacturer url, and more.
Mouser - Products - Discovery new products by category URL
Product url, Category url, Mouser part num, Mfr part number, Manufacturer, Image, Image high, Manufacturer url, and more.
Zalando products
Domain, Country code, URL, Sku, Condition, Gender, Product name, Brand, and more.
Zalando products - Discover products by domain
Domain, Country code, URL, Sku, Condition, Gender, Product name, Brand, and more.
Zalando products - Discover records by search keyword
Domain, Country code, URL, Sku, Condition, Gender, Product name, Brand, and more.
Zalando products - Discover products by category URL
Domain, Country code, URL, Sku, Condition, Gender, Product name, Brand, and more.
Zalando products - Collect products by brand URL
Domain, Country code, URL, Sku, Condition, Gender, Product name, Brand, and more.
Pinterest - Profiles
URL, Profile picture, Name, Nickname, Website, Bio, Following count, Follower count, and more.
Pinterest - Profiles - Discover profiles by Keyword in profile name and profile posts
URL, Profile picture, Name, Nickname, Website, Bio, Following count, Follower count, and more.
Apple App Store reviews
URL, Review id, Review title, Review rating, Reviewer name, Review date, Review, Developer response, and more.
Chileautos Chile - Cars Listings
URL, Marca, Modelo, Ano, Variante, Kilometraje, Condicion, Combustible, and more.
Asos - Products
URL, Name, Brand, Description, About me, Availability, Buy the look, Category, and more.
Asos - Products - Collect products by category URL
URL, Name, Brand, Description, About me, Availability, Buy the look, Category, and more.
Asos - Products - Collect products by keyword
URL, Name, Brand, Description, About me, Availability, Buy the look, Category, and more.
Asos - Products - Collect products by brand URL
URL, Name, Brand, Description, About me, Availability, Buy the look, Category, and more.
Lazada - Reviews
URL, Title, Rating, Reviews, Seller name, Sku, Mpn, Is super seller, and more.
Quora posts
URL, Post id, Author name, Title, Post date, Originally answered, Over all answers, Post text, and more.
Agoda Properties Listings
URL, Hotel id, Title, Location, Country, City, Metro railway access, Images, and more.
Agoda Properties Listings - collect properties by country
URL, Hotel id, Title, Location, Country, City, Metro railway access, Images, and more.
Agoda Properties Listings - collect properties by filter url
URL, Hotel id, Title, Location, Country, City, Metro railway access, Images, and more.
Lego - Products
Product name, Category, Description, Initial price, Final price, Currency, In stock, Availability, and more.
Lego - Products - Discovery new products by category URL
Product name, Category, Description, Initial price, Final price, Currency, In stock, Availability, and more.
Yapo Chile - marketplace ads
Title, Description, Seller name, Root category id, Root category name, Parent category id, Parent category name, Active, and more.
Bluesky - Posts
URL, Post id, Post date, Posted by, Post text, Comments, Reposts, Likes, and more.
Bluesky - Posts - Collect posts from profile URL
URL, Post id, Post date, Posted by, Post text, Comments, Reposts, Likes, and more.
VentureRadar company information
URL, Location, Name, Country code, Ownership, Score, Auto analyst score, Website popularity, and more.
Inmuebles24 Mexico - Properties Listings
URL, Title, GeneratedTitle, Description, Seller, Precio, Publicado hace, CreatedDate, and more.
Trustradius product reviews
URL, Product id, Product name, Review id, Review url, Review title, Review rating, Review date, and more.
Trustradius product reviews - discover all reviews by product url
URL, Product id, Product name, Review id, Review url, Review title, Review rating, Review date, and more.
Apple App Store
URL, Title, Sub title, Developer, Top charts, Monetization features, Image, Screenshots, and more.
Chanel Products
Product name, Product description, Country, Currency, Color, Variations, Free sample, Image slider, and more.
Chanel Products - Discover new products in Chanel by category URL
Product name, Product description, Country, Currency, Color, Variations, Free sample, Image slider, and more.
Metrocuadrado - Properties Listings
URL, ID, Precio, Habitaciones, Banos, Dimension propiedad, Dimension terreno, Comuna Ciudad, and more.
Hermes- Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Hermes- Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Home Depot CA
Domain, Country code, URL, Model number, Sku, Product name, Manufacturer, Description, and more.
Home Depot CA - Gather data on products using specified keywords
Domain, Country code, URL, Model number, Sku, Product name, Manufacturer, Description, and more.
Home Depot CA - discover records by category url
Domain, Country code, URL, Model number, Sku, Product name, Manufacturer, Description, and more.
Naver products
URL, Product id, Title, Original price, Final price, Discount rate, Currency, Description, and more.
Naver products - Discover products by category
URL, Product id, Title, Original price, Final price, Discount rate, Currency, Description, and more.
Dior - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Dior - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Vimeo - Videos posts
Video id, Title, URL, Uploader, Video url, Video length, Views, Likes, and more.
Vimeo - Videos posts - focus on licensed videos with "common creative" license
Video id, Title, URL, Uploader, Video url, Video length, Views, Likes, and more.
Vimeo - Videos posts - scrape videos by URL
Video id, Title, URL, Uploader, Video url, Video length, Views, Likes, and more.
AE.com - Complete Products
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Availability, and more.
AE.com - Complete Products - Discovery new products by category URL
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Availability, and more.
Toctoc - Properties Listings
Imagen, No de imagenes, Descripcion, Precio, Currency, Ubicacion, Habitaciones, Banos, and more.
Lazada products search (GMV)
URL, Name, Price, Currency, Number sold, Sku, Image url, Rating, and more.
Mediamarkt.de products
Brand, Description, Manufacturer, Ean, Sku, Initial price, Final price, In stock, and more.
Balenciaga.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Balenciaga.com - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Crawl API
Markdown, URL, Html2text, Page html, Ld json, Page title, and more.
Crawl API - Map all links from a given domain, collecting internal and external URLs for seamless analysis, auditing, or integration into your workflows.
Markdown, URL, Html2text, Page html, Ld json, Page title, and more.
Ashleyfurniture - Products
Product name, Brand, Initial price, Final price, Currency, In stock, Availability, Color, and more.
Ashleyfurniture - Products - sitemap
Product name, Brand, Initial price, Final price, Currency, In stock, Availability, Color, and more.
Ashleyfurniture - Products - Discovery new products by category URL
Product name, Brand, Initial price, Final price, Currency, In stock, Availability, Color, and more.
Mango Products
Product name, Price, Image, Size, Product article, Availability, Description, Colour code, and more.
Infocasas Uruguay - Properties Listings
URL, ID, Imagen, Descripcion, Precio, Ubicacion, Habitaciones, Banos, and more.
Toysrus - Products
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Reviews count, and more.
Toysrus - Products - Discovery new products by category URL
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Reviews count, and more.
Properati Argentina and Colombia - Properties Listings
Type, Name, Estrato, Habitaciones, Banos, M2, Descripcion, Precio, and more.
Twitch - streams dataset
URL, Stream id, Streamer name, Verified partner, Stream title, Tags, Viewers number, Stream time, and more.
Twitch - streams dataset - Discover stream by a search term
URL, Stream id, Streamer name, Verified partner, Stream title, Tags, Viewers number, Stream time, and more.
Twitch - streams dataset - Discover stream by category url
URL, Stream id, Streamer name, Verified partner, Stream title, Tags, Viewers number, Stream time, and more.
Fanatics.com - Products
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Color, and more.
Fanatics.com - Products - Discovery new products by category URL
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Color, and more.
Carters.com - Products
Product name, Description, In stock, Availability, Color, Size, Reviews count, Category url, and more.
Carters.com - Products - Discovery new products by category URL
Product name, Description, In stock, Availability, Color, Size, Reviews count, Category url, and more.
Zara Home Products
Category id, Category key, Category name, Product id, Product name, Price, Price discount, Price with fillings, and more.
Google Maps full information
Place id, URL, Country, Name, Category, Address, Description, Business details, and more.
Google Maps full information - discover records by location search
Place id, URL, Country, Name, Category, Address, Description, Business details, and more.
Google Maps full information - Collect Google Maps Businesses data by place id
Place id, URL, Country, Name, Category, Address, Description, Business details, and more.
Google Maps full information - Discover new records by Customer ID
Place id, URL, Country, Name, Category, Address, Description, Business details, and more.
Ysl.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Fendi Products
Product id, URL, Product name, Product description, Short description, Image, Price, Currency, and more.
Fendi Products - Discover products by category URL
Product id, URL, Product name, Product description, Short description, Image, Price, Currency, and more.
Prada.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Prada.com - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Crateandbarrel - Products
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Availability, and more.
Crateandbarrel - Products - Discovery new products by category URL
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Availability, and more.
Loewe.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Loewe.com - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Delvaux - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Delvaux - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Bottegaveneta.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Bottegaveneta.com - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Walmart - products zipcodes
URL, Final price, Sku, Currency, Gtin, Specifications, Image urls, Top reviews, and more.
Walmart - products zipcodes - Collect data by category URL
URL, Final price, Sku, Currency, Gtin, Specifications, Image urls, Top reviews, and more.
Walmart - products zipcodes - Collect data by Keyword
URL, Final price, Sku, Currency, Gtin, Specifications, Image urls, Top reviews, and more.
Mybobs.com - Products
Product name, Initial price, Final price, Currency, In stock, Main image, Category tree, Country code, and more.
Mybobs.com - Products - Discovery new products by category URL
Product name, Initial price, Final price, Currency, In stock, Main image, Category tree, Country code, and more.
Celine.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Celine.com - Products - Discover new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Massimo Dutti - Products
URL, Title, Price, Product type, Family name, Subfamily name, Images, Size, and more.
Massimo Dutti - Products - Discovery new products by category URL
URL, Title, Price, Product type, Family name, Subfamily name, Images, Size, and more.
Sleepnumber.com - Products
Description, Initial price, Final price, Currency, In stock, Color, Size, Reviews count, and more.
Sleepnumber.com - Products - Discovery new products by category URL
Description, Initial price, Final price, Currency, In stock, Color, Size, Reviews count, and more.
ChatGPT Search
URL, Prompt, Answer html, Answer text, Links attached, Citations, Recommendations, Country, and more.
Berluti.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Berluti.com - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Mattressfirm - Products
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Color, and more.
Mattressfirm - Products - Discovery new products by category URL
Product name, Brand, Description, Initial price, Final price, Currency, In stock, Color, and more.
llbean.com - Products
IDentity, Product name, URL, Description, Category tree, Color, Country code, County of origin, and more.
llbean.com - Products - Discovery new products by category URL
IDentity, Product name, URL, Description, Category tree, Color, Country code, County of origin, and more.
Montblanc - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Montblanc - Products - Discovery new products by category URL
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Raymourflanigan.com - Products
Product name, Seller name, Brand, Description, Initial price, Final price, Currency, In stock, and more.
La-z-boy.com - Products
Product name, Description, Initial price, Final price, Currency, In stock, Size, Reviews count, and more.
La-z-boy.com - Products - Discovery new products by category URL
Product name, Description, Initial price, Final price, Currency, In stock, Size, Reviews count, and more.
Moynat.com - Products
Product name, Description, Country, Currency, In stock, Size, Color, Main image, and more.
Zillow Full Properties Information
URL, Photos, Responsive photos, Has vr model, Description, Home status, Contingent listing type, What i love, and more.
Zillow Full Properties Information - Discover zillow records by zillow search url
URL, Photos, Responsive photos, Has vr model, Description, Home status, Contingent listing type, What i love, and more.
Zillow properties search page
URL, Zpid, Zipcode, Description, City, Country, State, Address, and more.
LinkedIn people search
URL, Name, Subtitle, Location, Experience, Education, Avatar, and more.
Walmart products search
ID, URL, Typename, Buy box suppression, Similar items, Us item id, Is bad split, Name, and more.
Perplexity Search
URL, Prompt, Answer html, Answer text, Answer text markdown, Sources, Source html, and more.
Snapchat posts
URL, Post id, Profile name, Profile handle, Profile link, Num comments, Num shares, Num views, and more.
Snapchat posts - Discover posts by profile url
URL, Post id, Profile name, Profile handle, Profile link, Num comments, Num shares, Num views, and more.
Snapchat posts - Discover new posts by search url
URL, Post id, Profile name, Profile handle, Profile link, Num comments, Num shares, Num views, and more.
Agoda Listings Search
URL, Location, Check in, Check out, Adults, Children, Rooms, ID, and more.
217+TikTok - Posts by URL Fast API
URL, Post id, Description, Create time, Digg count, Share count, Collect count, Comment count, and more.
Bing Copilot Search
URL, Prompt, Answer html, Answer text, Answer text markdown, Sources, and more.
Grok Search
URL, Prompt, Answer text, Answer html, Index, Answer text markdown, Citations, and more.
Perplexity Search - Places Tab
URL, Prompt, Place name, Rating, Opening hour, Image url, Map url, Phone number, and more.
Snapchat profile
URL, Profile id, Profile name, Profile username, Profile alternate name, Profile description, Profile address, Profile image url, and more.
216+Gemini Search
URL, Prompt, Answer html, Answer text, Links attached, Citations, Country, Index, and more.
TikTok - Posts by Search URL Fast API
URL, Post id, Description, Create time, Digg count, Share count, Collect count, Comment count, and more.
TikTok - Posts by Profile Fast API
URL, Post id, Description, Create time, Digg count, Share count, Collect count, Comment count, and more.
UNDER THE HOOD
Never worry about proxies and CAPTCHAs again
- Automatic IP Rotation
- CAPTCHA Solver
- User Agent Rotation
- Custom Headers
- JavaScript Rendering
- Residential Proxies
Just want data? Skip scraping.
Purchase a ready-to-use dataset
PRICING
Sitemap Scraper subscription plans
CUSTOM SCRAPERS
Subscription
Starting from
$400/month
One time
Starting from
$1,200
- AI-Generated schema & sample
- Control over data validation
- Real-time product quantity est.
- Daily, Weekly, Monthly, Custom
DEPLOY FASTER
Scraping Sitemap has never been easier.
Data Discovery
Detecting data structures and patterns to ensure efficient, targeted extraction of data.
Bulk Request Handling
Reduce server load and optimize data collection for high-volume scraping tasks.
Data Parsing
Efficiently converts raw HTML into structured data, easing data integration and analysis.
Data validation
Ensure data reliability and save time on manual checks and preprocessing.
Seamless Sitemap Data Access
Comprehensive, Scalable, and Compliant Sitemap Data Extraction
FLEXIBLE
Tailored to your workflow
Get structured data in JSON, NDJSON, or CSV files through Webhook or API delivery.
SCALABLE
Built-in infrastructure and unblocking
Get maximum control and flexibility without maintaining proxy and unblocking infrastructure. Easily scrape data from any geo-location while avoiding CAPTCHAs and blocks.
STABLE
Battle-proven infrastructure
Bright Data’s platform powers over 20,000+ companies worldwide, offering peace of mind with 99.99% uptime, access to 150M+ real user IPs covering 195 countries.
COMPLIANT
Industry leading compliance
Our privacy practices comply with data protection laws, including the EU data protection regulatory framework, GDPR, and CCPA – respecting requests to exercise privacy rights and more.
Why 20,000+ Customers Choose Bright Data
100% Compliant
Scraped data is ethically obtained and compliant with all privacy laws.
24/7 Global Support
A dedicated team of data professionals is here to help.
Complete Data Coverage
Access 150 million+ global IPs to scrape data from any website.
Unmatched Data Quality
Advanced technologies and validation methods for quality data.
Powerful Infrastructure
Scrape high-volume data without getting blocked.
Custom Solutions
Get tailored solutions to meet unique needs and goals.
Sitemap Scraper FAQs
What is the custom Sitemap Scraper?
The Sitemap scraper is a powerful tool designed to automate data extraction from Sitemap, enabling users to efficiently gather and process large volumes of prediction market data for various use cases.
How does the Sitemap Scraper work?
The Sitemap Scraper works by sending automated requests to Sitemap, extracting the necessary data points, and delivering them in a structured format. This process ensures accurate and quick data collection.
Is the Sitemap Scraper compliant with data protection regulations?
Yes, the Sitemap Scraper is designed to comply with data protection regulations, including GDPR and CCPA. It ensures that all data collection activities are performed ethically and legally.
Do you provide support for the Sitemap Scraper?
Yes, we offer dedicated support for the Sitemap Scraper. Our support team is available 24/7 to assist you with any questions or issues you may encounter while using the API.
What delivery methods are available?
Amazon S3, Google Cloud Storage, Google PubSub, Microsoft Azure Storage, Snowflake, and SFTP.
What file formats are available?
JSON, NDJSON, JSON lines, CSV, and .gz files (compressed).