Does Bot Use Need Tighter External Regulations and Guidelines?

A recent survey conducted by Vanson Bourne in conjunction with Bright Data aimed at US and UK decision-makers from financial services, IT, and technology organizations, looks into the increased role bots play in automating key corporate functions, including customer service, web data collection, and more, as well as the thirst for tighter regulations.
Rogue Bots on the Loose- Does Bot Use Need Tighter External Regulations and Guidelines
Jessican Cammerman
Jessica Cammerman | Brand Marketing Manager

The most common uses of bots

As you probably know, the digital world is fast replacing human contact with virtual assistants and automation. When was the last time you interacted with a bot while surfing the internet? While their existence evokes strong opinions for and against, their growing prevalence is undebatable.

Here is what our CTO, Ron Kol, had to say to City A.M:

“Bots are no longer just a futuristic ambition. It’s clear that they are now playing a crucial role in driving the real-time economy forward. Bot usage has been growing rapidly in recent years, and this research highlights the rising number of use cases for this vital technology.”

Let’s take a closer look at how bots are most commonly used:

Corporate Environments

When contacting customer services, often there is no person on the other side. Instead, a bot is handling your queries and feedback, automating the process, saving time, and lowering costs. In fact, 76% of surveyed organizations are using bots for their customer services, making corporate environments the most popular use case.


The second most popular bot use case may come as a surprise: 69% of UK and 48% of US respondents report using bots for web data-related applications. This can include anything from generating analytics responses from the data that bots have collected to even getting the bots to process large datasets.

Other Common Uses

The uses for bots are far from limited. With 95% of organizations surveyed planning to expand their automated functions, and with that bot usage, bots will become even more common in the next two years. Other common uses of bots revealed in the survey include cybersecurity (51%), the automation of backend tasks (35%), automated trading (23%), and social media engagement (22%).

Demand for guidelines and regulation

Like most technology, bots can also be exploited. However, overall, they add significant value to our lives, changing the way we work, saving businesses thousands of hours and significant sums per year, and streamlining user experiences.

Unfortunately, myths and misconceptions about this technology are rife. Often, the public hears about bad bots used by scalpers and those in DDoS attacks. Other irresponsible uses include sending spam and trying to obtain personal data.

So, given such instances of exploitation, should bots be regulated?

Currently, 47% of people in US organizations and 60% of those in the UK are happy with the current level of regulation. That being said, there is still room for improvement, as highlighted by the different approaches that different countries have taken to creating bot regulations. The research shows that 45% of US organizations and 33% of UK organizations are wanting to see increased external regulation of bots.

And who are creating their own guidelines?

In the US, 48% of those surveyed say they have guidelines in place to moderate all uses of bots, while another 48% say they have guidelines relating to some uses of bots. In the UK, these figures are 57% and 40%, respectively.

Meanwhile, of those surveyed, 96% and 97%, respectively, have created guidelines of some sort, with the UK leading on covering all uses. This suggests that organizations in both locations feel the need for guidelines and regulations.

Outsourcing bot operations

“Given that the bot space is so fast-moving, outsourcing bot operations makes it even easier for financial services, IT, and technology organizations to focus on what they excel at and leave the bot management to the professionals,” said our CTO, Ron Kol.

The statistics:

–          38% of US organizations and 19% of UK organizations outsource the majority of their bot operations

–          74% of UK organizations and 53% of US organizations outsource some of their bot operations

–          52% percent of US organizations and 50% of UK organizations say their IT team primarily dictates or controls the bots used in their organization

As we can see, outsourcing is a popular option. In fact, outsourcing some bot operations is very popular, which increases the need for regulations. This is specifically the case when organizations are, on average, only 50% in control of what their bots are doing.

The Bottom Line

“It’s no surprise that bot usage is growing within the data sector. For this to be both effective and sustainable, organizations need to be responsible when collecting public web data or choosing a third-party to do this for them – this includes advocating for increased global regulation.” Ron Kol, Bright Data CTO

Bots are a groundbreaking tech-forward tool that must be managed and comprehensively protected by each and every organization or business, similar to the way employee or customer identity is protected. To achieve that, we must establish an extensive framework so that valued bots are not compromised by malicious actors. 

Looking ahead, bots should only be used for the exact purpose they were created for – to make us all more efficient and effective, especially when accessing the vast pool of public web data.

Jessican Cammerman
Jessica Cammerman | Brand Marketing Manager

Jess is the Brand Marketing Manager at Bright Data. She hails from Australia, with extensive marketing experience, and a passion for all things tech-related

You might also be interested in

What is data aggregation

Data Aggregation – Definition, Use Cases, and Challenges

This blog post will teach you everything you need to know about data aggregation. Here, you will see what data aggregation is, where it is used, what benefits it can bring, and what obstacles it involves.
What is a data parser featured image

What Is Data Parsing? Definition, Benefits, and Challenges

In this article, you will learn everything you need to know about data parsing. In detail, you will learn what data parsing is, why it is so important, and what is the best way to approach it.
What is a web crawler featured image

What is a Web Crawler?

Web crawlers are a critical part of the infrastructure of the Internet. In this article, we will discuss: Web Crawler Definition A web crawler is a software robot that scans the internet and downloads the data it finds. Most web crawlers are operated by search engines like Google, Bing, Baidu, and DuckDuckGo. Search engines apply […]

A Hands-On Guide to Web Scraping in R

In this tutorial, we’ll go through all the steps involved in web scraping in R with rvest with the goal of extracting product reviews from one publicly accessible URL from Amazon’s website.

The Ultimate Web Scraping With C# Guide

In this tutorial, you will learn how to build a web scraper in C#. In detail, you will see how to perform an HTTP request to download the web page you want to scrape, select HTML elements from its DOM tree, and extract data from them.
Javascript and node.js web scraping guide image

Web Scraping With JavaScript and Node.JS

We will cover why frontend JavaScript isn’t the best option for web scraping and will teach you how to build a Node.js scraper from scratch.
Web scraping with JSoup

Web Scraping in Java With Jsoup: A Step-By-Step Guide

Learn to perform web scraping with Jsoup in Java to automatically extract all data from an entire website.
Static vs. Rotating Proxies

Static vs Rotating Proxies: Detailed Comparison

Proxies play an important role in enabling businesses to conduct critical web research.