--- title: "Using Node Unblocker for Web Scraping" slug: node-unblocker-web-scraping date: 2023-08-27T14:48:43+00:00 modified: 2026-08-26T16:56:14+00:00 permalink: https://brightdata.com/blog/how-tos/node-unblocker-web-scraping type: blog --- [ Blog ](https://brightdata.com/blog "Blog") / [How Tos](https://brightdata.com/blog/how-tos) [How Tos](https://brightdata.com/blog/how-tos) # Using Node Unblocker for Web Scraping In this tutorial, you will explain to the readers what node-unblocker is, its advantages in web scraping projects, and how it’s used. 9 min read [ ](https://brightdata.com/blog/authors/kevin-kimani) [Kevin Kimani ](https://brightdata.com/blog/authors/kevin-kimani) ![Node Unblocker for Web Scraping](https://media.brightdata.com/2023/08/Node-Unblocker-for-Web-Scraping.svg) When [web scraping with Node.js](/blog/how-tos/web-scraping-with-node-js), you might encounter obstacles such as internet censorship and slow proxies. Thankfully, there’s a solution called [node unblocker](https://github.com/nfriedly/node-unblocker) that can help. Unblocker is a web proxy that enables developers to bypass internet censorship and access geo-restricted content. It’s an open source solution with benefits including fast data relay, easy [customization options](https://github.com/nfriedly/node-unblocker#configuration), and support for multiple protocols. With unblocker, you can overcome internet restrictions and efficiently scrape data from websites that would otherwise be inaccessible. In this article, you’ll learn all about unblocker, including its advantages in web scraping projects. You’ll also learn how to use it to create a proxy that can be used to scrape geo-restricted content. ## Advantages of Using Node Unblocker Node Unblocker offers a wide array of benefits and functionalities that make it a valuable tool for internet users seeking unrestricted access to web content. In addition to being an open source solution, its other advantages include the following: - acts as an intermediary - **Relays data fast and efficiently:** Unblocker excels at delivering data to the client without buffering. As a result, it’s one of the fastest proxy solutions available. - **Is easy to use:** Unblocker provides a user-friendly interface that’s great for users of all skill levels. If you want to integrate the solution into your project, unblocker offers an accessible API that’s easy to implement. - **Can be highly customizable:** With unblocker, developers have the flexibility to customize the proxy according to their specific scraping requirements. For instance, you can configure parameters like request headers and response handling, providing a personalized and efficient scraping process. - **Supports multiple protocols:** Unblocker supports various protocols such as HTTP, HTTPS, and WebSockets. This versatility enables seamless integration with different scraping scenarios, offering developers the flexibility and convenience to interact with a wide range of data sources. ## How to Get Started with Unblocker Now that you know all the benefits that unblocker offers, it’s time to get started using it. Before you begin, you need to make sure that you have [Node.js](https://nodejs.org/en) and [npm](https://www.npmjs.com/) installed on your system. You also need a web browser to test the project and a free [Render account](https://dashboard.render.com/register) to host the solution. Once you’ve completed these prerequisites, it’s time to create the web proxy. To do so, create a folder named `node-unblocker-proxy`, open it in your terminal, and execute the following command to initialize a new Node.js project: ```none npm init -y ``` Then execute the following command to install the dependencies that you need: ```none npm install express unblocker ``` `express` is the web application framework that you use to set up a web server. `node-unblocker` is the npm package that helps you create the web proxy. ### Write the Script to Create the Proxy Once all your dependencies are set up, it’s time to implement the web proxy script. Create an `index.js` file in the project root folder and paste the following code into it: ```none // import required dependencies const express = require("express"); const Unblocker = require("unblocker"); // create an express app instance const app = express(); // create a new Unblocker instance const unblocker = new Unblocker({ prefix: "/proxy/" }); // set the port const port = 3000; // add the unblocker middleware to the Express application app.use(unblocker); // listen on specified port app.listen(port).on("upgrade", unblocker.onUpgrade); console.log(`proxy running on http://localhost:${port}/proxy/`); ``` In this code, you import the required dependencies and create an instance of the [Express](https://expressjs.com/) app. Additionally, you create a new `Unblocker` instance, which allows for a wide range of [configuration options](https://github.com/nfriedly/node-unblocker/blob/master/readme.md#configuration). Here, you only set the `prefix` option, specifying the path that the proxied URLs should begin with. Because unblocker exports an Express-compatible API, integrating it into an Express application is easy. All you have to do is call the `use()` method of the Express app instance and pass the `Unblocker` instance. Then you start the Express application using the `listen()` method. `.on("upgrade", unblocker.onUpgrade)` ensures that the WebSocket connections are correctly handled by unblocker. ### Test the Proxy Locally To test the proxy implementation locally, execute the following command in your terminal: ```none node index.js ``` > You can also use the command `DEBUG=unblocker:* node index.js` if you want to see detailed information on each request made via the proxy. Next, take any URL and prefix it with `localhost/proxy/` (*eg* `localhost/proxy/https://brightdata.com/`), and open it in your web browser. You should see the **Bright Data** home page. Quickly inspect your browser’s **Network** tab, and you’ll see that all the requests are going through the proxy (you can see this by viewing the **Domain** column in the **Network** tab): ### Deploy the Proxy to Render Now that you’ve tested the proxy, it’s time to deploy it. Before you do that, open the `package.json` file in the project root folder and modify the `scripts` key-value pair with the following: ```none "scripts": { "start": "node index" } ``` This provides a command to start the Express web server once it’s hosted on Render. To deploy the web proxy and [upload](https://docs.github.com/en/migrations/importing-source-code/using-the-command-line-to-import-source-code/adding-locally-hosted-code-to-github) the proxy code to a GitHub repository. Then [sign into](https://dashboard.render.com/login) your Render account: Click the **New +** button and select **Web Service**: Connect your web proxy repository by selecting the **Connect** button. You might need to [configure your account](https://render.com/docs/github#fixing-github-app-permissions) for Render to be able to access the repository. This is only necessary if you haven’t configured Render to access the specific GitHub repository: Fill out the required details for your web service and select **Create Web Service** at the bottom of the page: > You can leave the start command as is if you prefer using [Yarn](https://yarnpkg.com/), or you can change it to `npm run start` if you want to use npm. After the web proxy has been successfully deployed, it’s time to test it. Take any URL and prefix it with the deployed `/proxy/` (*eg* `https://node-web-proxy-gvn6.onrender.com/proxy/https://brightdata.com/`). Then open it in your web browser. Inspect your browser’s network tab, and you should see that all the requests are going through the deployed proxy: ### Use the Proxy to Make Scraping Requests Once you’ve verified that all the requests are going through the deployed proxy, it’s time to make a scraping request. In this tutorial, you’ll use the [Puppeteer](https://pptr.dev/) library, but any other testing library, such as [Cheerio](https://cheerio.js.org/) or [Nightmare](https://github.com/segmentio/nightmare), works. If you don’t already have Puppeteer installed, do so now by running `npm i puppeteer`. Then create a `scrape.js` file in the project root folder and add the following code: ```none // import puppeteer const puppeteer = require("puppeteer"); const scrapeData = async () => { // launch the browser const browser = await puppeteer.launch({ headless: false, }); // open a new page and navigate to the defined URL const page = await browser.newPage(); await page.goto("/proxy/https://brightdata.com/blog"); // get the content of the webpage const data = await page.evaluate(() => { // variable to hold all the posts data let blogData = []; // extract all elements with the specified class const posts = document.querySelectorAll(".post_item"); // loop through the posts object, extract required data and push it to the blogData array for (const post of posts) { const title = post.querySelector("h5").textContent; const link = post.href; const author = post .querySelector(".author_box") .querySelector(".author_box__details") .querySelector("div").textContent; const article = { title, link, author }; blogData.push(article); } return blogData; }); // log the data to the console console.log(data); // close the browser instance await browser.close(); }; // call the scrapeData function scrapeData(); ``` > Remember to replace `` with the URL of the app that you deployed on Render. This code snippet sets up Puppeteer and scrapes blog post data from the [Bright Data blog](/blog/). All the blog post cards on the Bright Data website have a class name of `.post_item`. It retrieves all the posts; loops through the `posts` object; extracts the title, link, and author of each post; pushes this data into the `blogData` array; and finally, logs all this information to the console. ## How to Choose The Best Proxy for Your Node Unblocker? When integrating a proxy with Node Unblocker, it’s crucial to tailor your choice to your project’s demands and the specific challenges you anticipate. Here are several key aspects to consider when selecting a proxy: 1. **Performance and Reliability:** Opt for a proxy known for its fast connection speeds and high availability to ensure seamless data access and web scraping efficiency. 2. **Geographical Flexibility:** Choose a proxy that offers a wide [range of geographical locations](/locations). This feature is vital for bypassing regional restrictions and accessing localized content. 3. **IP Rotation:** To reduce the risk of being blocked by websites, select a proxy service that provides rotating IP addresses. This feature helps maintain access by presenting new IPs on each request. 4. **Security Protocols:** Ensure the proxy service includes robust security measures like SSL encryption to protect your data integrity and privacy, particularly if you handle sensitive information. 5. **Scalability:** Consider whether the proxy service can scale up to meet increasing demands as your scraping needs grow. Flexibility in scaling resources is crucial for supporting larger or more complex scraping tasks. 6. **Support and Documentation:** Comprehensive support and detailed documentation can greatly ease the integration process, especially when configuring complex setups with Node Unblocker. By carefully evaluating these factors, you can select [a proxy service](/proxy-types) that not only fits your current needs but also accommodates future growth and changes in your scraping activities. ## Conclusion Node Unblocker provides a robust solution for web scraping in Node.js, offering developers the ability to bypass internet censorship and access geo-restricted content. Its user-friendly interface, extensive customization options, and support for multiple protocols make it a valuable tool for efficiently scraping data from websites. In this guide, you learned all about unblocker, its advantages in web scraping projects, and how you can use it. In today’s data-driven world, web scraping has become an indispensable tool for gathering valuable insights and information. However, [web scraping](/products/web-scraper) comes with its fair share of challenges, such as IP blocking, rate limiting, and geo-restrictions, which can impede data collection efforts and hinder the acquisition of crucial data. Bright Data offers an all-encompassing infrastructure that addresses these challenges. With a vast network of [residential](/proxy-types/residential-proxies), [ISP](/proxy-types/isp-proxies), [datacenter](/proxy-types/datacenter-proxies), and [mobile IPs](/proxy-types), Bright Data allows users to route their scraping requests through a diverse range of IP addresses from around the world. This not only ensures anonymity but also provides the ability to access geo-restricted content and overcome obstacles that may hinder data collection efforts. ***Not sure which Bright Data proxy you need? Register now and talk to one of our data experts and find the best solution for your needs.*** Contact usStart free trial No credit card required Kevin Kimani [ View all articles ](https://brightdata.com/blog/authors/kevin-kimani) Table of Contents Dedicated Scraper APIs & No-Code Scrapers Over 1000 scrapers for all popular domains. Simplify your web scraping. [See pricing](/pricing/web-scraper "See pricing") Just want data? Skip scraping. Hundreds of ready-to-use datasets from all popular domains. [See pricing](/pricing/datasets "See pricing") [ ](https://news.ycombinator.com/submitlink?t=Using+Node+Unblocker+for+Web+Scraping&u=https://brightdata.com/blog/how-tos/node-unblocker-web-scraping) [ ](https://www.linkedin.com/shareArticle?mini=true&title=Using+Node+Unblocker+for+Web+Scraping&url=https://brightdata.com/blog/how-tos/node-unblocker-web-scraping) [ ](http://www.reddit.com/submit?title=Using+Node+Unblocker+for+Web+Scraping&url=https://brightdata.com/blog/how-tos/node-unblocker-web-scraping) ## You might also be interested in [ ](https://brightdata.com/blog/ai/openhuman-with-bright-data "Production-Ready Web Access in OpenHuman Through the Bright Data CLI") [AI Antonello Zanini Technical Writer ### Production-Ready Web Access in OpenHuman Through the Bright Data CLI Integrate Bright Data CLI with OpenHuman to enable production-ready web access and data collection for AI agents. 09-Sep-2026 12 min read ](https://brightdata.com/blog/ai/openhuman-with-bright-data) [ ](https://brightdata.com/blog/ai/minimax-m3-with-bright-data "Giving self-hosted MiniMax M3 agents live web access with Bright Data") [AI Satyam Tripathi Technical Writer ### Giving self-hosted MiniMax M3 agents live web access with Bright Data Self-hosted MiniMax M3 agents get live web access using Bright Data’s search and scraping tools. Bypass blocks and CAPTCHAs. 09-Sep-2026 54 min read ](https://brightdata.com/blog/ai/minimax-m3-with-bright-data) [ ](https://brightdata.com/blog/web-data/multimodal-web-scraping-with-minimax "Multimodal Web Scraping with MiniMax") [Web Data Antonello Zanini Technical Writer ### Multimodal Web Scraping with MiniMax Pair Bright Data Web Unlocker with MiniMax M3 vision to extract structured data from images and web page screenshots. 09-Sep-2026 4 min read ](https://brightdata.com/blog/web-data/multimodal-web-scraping-with-minimax)