WebHarvy Proxy Integration
WebHarvy is a web scraping tool that can easily extract text, HTML, images, URLs, and emails from websites and save the extracted content in various formats. If you are running a large scraping operation, using one of the proxy services Bright Data offers will help you increase the success rates and send a lot more concurrent requests to the same target.
Setting up WebHarvy
- Download and install WebHarvy Web Scraper
- Go to Webharvy → Home tab → Settings → Proxy Settings
Setting up Bright Data account
- Sign up for Bright Data’s Proxy Network
- Go to your Bright Data dashboard
- In the Integrate with Bright Data Proxy Network section, select With a crawler or a bot option
- Click the Next button
- On the API Examples page, you will see the following details:
Proxy address, Port number, User name, and Password
- Go back to WebHarvy Proxy settings and paste the details from Bright Data to WebHarvy Proxy settings
- Click on the + button
- Click Apply
Please note:
Webharvy will use proxy servers only during mining.
The configuration browser of Webharvy will not use this proxy server, so if you check the IP address within the configuration browser, it will still be the original IP of your computer.
To make the configuration browser use the proxy server, you should set the proxy address directly in Windows.
To disable the proxy server, you just need to uncheck the Enable Network connection via Proxy server checkbox at Webharvy → Home Menu → Settings → Proxy Settings Tab.
Alternatively, you can use our own data collection tool for a quicker and easier process.
About Bright Data proxies:
Residential proxies: With over 72 million real IPs from 195 countries, Bright Data’s residential proxies enable you to access any website content regardless of location, while avoiding IP bans and CAPTCHAs.
ISP proxies: With over 700,000 ISP IPs, leverage real static IPs from any city in the world, assigned by ISPs and leased to Bright Data for your exclusive use, for as long as you require.
Datacenter proxies: With over 770,000 datacenter IPs, Bright Data’s datacenter proxy network is built of multiple IP types across the world, in a shared IP pool or for individual purchase.
Mobile proxies: With over 7 million mobile IPs, Bright Data’s advanced Mobile IP Network offers the fastest and largest real-peer 3G/4G/5G IPs network in the world.
