WebHarvy Proxy Integration
Integrating WebHarvey with Bright Data proxies improves automated web scraping by offering secure, flexible proxy management for seamless and reliable data extraction.
This guide may be outdated. For an up-to-date guide please see our documentation.
- 400M+ Residential IPs
- Sticky and rotating sessions
- 99.95% success rate
- Geo-location targeting - FREE
What is WebHarvy?
WebHarvy is a web scraping tool that can easily extract text, HTML, images, URLs, and emails from websites and save the extracted content in various formats. If you are running a large scraping operation, using one of the proxy services Bright Data offers will help you increase the success rates and send a lot more concurrent requests to the same target.
How to setup WebHarvy
with Bright Data proxies:
- Download and install WebHarvy Web Scraper
- Go to Webharvy → Home tab → Settings → Proxy Settings
- Sign up for Bright Data’s Proxy Network
- Go to your Bright Data dashboard
- In the Integrate with Bright Data Proxy Network section, select With a crawler or a bot option
- On the API Examples page, you will see the following details:
- Proxy address, Port number, User name, and Password
- Go back to WebHarvy Proxy settings and paste the details from Bright Data to WebHarvy Proxy settings
- Click on the + button
- Click Apply
Please note: Webharvy will use proxy servers only during mining. The configuration browser of Webharvy will not use this proxy server, so if you check the IP address within the configuration browser, it will still be the original IP of your computer. To make the configuration browser use the proxy server, you should set the proxy address directly in Windows.
To disable the proxy server, you just need to uncheck the Enable Network connection via Proxy server checkbox at Webharvy → Home Menu → Settings → Proxy Settings Tab.
Alternatively, you can use our own data collection tool for a quicker and easier process.
⚠️Important note: If you are using Bright Data’s Residential Proxies, Web Unlocker or SERP API, you need to install an SSL certificate to enable end-to-end secure connections to your target website(s). This is a simple process, see https://docs.brightdata.com/general/account/ssl-certificate#installation-of-the-ssl-certificate for instructions.
Ready to get started?
Powered by an award-winning proxy infrastructure
Over 400 million residential IPs, best-in-class technology and the ability to target any country, city, ZIP Code, carrier, & ASN make our premium proxy services a top choice for developers.
A proxy for every development path
Mix-and-match networks, peers, and IPs to optimize your continuous flow of web data.
Proxy Network Pricing
Using AWS? You can now pay through the AWS Marketplace The best customer experience in the industry
New feature releases every day
To answer any questions right when you need it
Real-time network performance dashboard
To optimize your performance
To meet your data collection goals
The category leader in proxies and data collection
650TB of public data collected every day
New feature releases every day
Serving 7/10 of the world’s leading universities
