GitHub Datasets
The GitHub dataset offers a comprehensive view of the open-source software ecosystem, providing detailed insights into repository attributes and developer contributions. Key data points include coding languages, repository sizes, user contributions, issues, pull requests, forks, and other engagement metrics, making it an invaluable resource for analyzing software development trends and community involvement.
Trusted by 20,000+ customers worldwide
Available datasets
- Demo data in JSON/CSV
- Fresh records
- Customize, enrich, and format the data
LinkedIn people profiles
Amazon products
LinkedIn company information
Instagram - Profiles
Crunchbase companies information
Linkedin job listings information
Zillow properties listing information
Instagram - Posts
LinkedIn posts
X (formerly Twitter) - Posts
Google Maps full information
TikTok - Profiles
Facebook - Pages Posts by Profile URL
Youtube - Videos posts
Amazon Reviews
TikTok - Posts
Indeed job listings information
Shopee - products
Companies information enriched dataset
Walmart - products
Employees business enriched dataset
TikTok Shop
YouTube - Profiles
Glassdoor companies overview information
IMDB media
X (formerly Twitter) - Profiles
Airbnb Properties Information
Google maps reviews
Reddit- Posts
Yahoo Finance business information
Google News
Instagram - Reels
Booking Hotel Listings
Glassdoor companies reviews
Shein- Products
LinkedIn profiles Jobs Listings
Yelp businesses overview
Facebook - Comments
Instagram - Comments
Zoominfo companies information
pitchbook companies information
Glassdoor job listings information
Otodom Poland
Amazon sellers info
Google Shopping
Amazon products global dataset
G2 software product overview
eBay
Github repository
Facebook - Posts by group URL
Amazon best seller products
Home Depot US
Australia real estate properties
Facebook Marketplace
Facebook - Posts by post URL
Etsy
Google Play Store
TikTok - Comments
Trustpilot business reviews
G2 software - product reviews
Amazon products search
Booking Listings Search
Goodreads books
Yelp businesses reviews
Reddit - Comments
Amazon Walmart
World population
Zillow price history
Zara - Products
Indeed companies info
Wikipedia articles
Zoopla properties listing information
Target
Facebook - Profiles
Pinterest - Posts
Youtube - Comments
Lazada - Products
Best Buy products
NBA players' stats
Walmart sellers info
Facebook Events
Lowes.com
Ikea - Products
Realtor international properties listings
Sephora products
BBC news
OLX Brazil - marketplace ads
Xing social network
Facebook - Pages and Profiles
Ozon.ru products
Facebook - Reels by profile URL
Google Play Store reviews
Facebook Company Reviews
Google Shopping products search US
Creative Commons Images
Myntra products
Wayfair products
Owler companies information
Slintel 6sense company information
H&M - Products
Digikey - Products
Naver products
US lawyers directory
Webmotors Brasil - Cars Listings
Tokopedia Products
Manta businesses
Apple App Store reviews
Mouser - Products
CNN news
Agoda Properties Listings
Wildberries.ru products
Zonaprop Argentina - Properties Listing
Carsales Cars Listings search page information
Quora posts
Pinterest - Profiles
VentureRadar company information
Zalando products
Inmuebles24 Mexico - Properties Listings
Chileautos Chile - Cars Listings
Yapo Chile - marketplace ads
Asos - Products
Trustradius product reviews
Lazada - Reviews
Vimeo - Videos posts
Bluesky - Posts
World zipcodes
Hermes- Products
Lego - Products
Metrocuadrado - Properties Listings
mercadolivre.com.br products
Home Depot CA
Chanel Products
Dior - Products
Toctoc - Properties Listings
Lazada products search (GMV)
Top 500 Bluesky Profiles
Kroger.com
Ashleyfurniture - Products
Apple App Store
Creative Commons 3D Models
Properati Argentina and Colombia - Properties Listings
Infocasas Uruguay - Properties Listings
AE.com - Complete Products
Mango Products
Balenciaga.com - Products
Mediamarkt.de products
Fanatics.com - Products
Toysrus - Products
Zara Home Products
Crateandbarrel - Products
Carters.com - Products
Rona.ca products
Loewe.com - Products
Prada.com - Products
Fendi Products
Delvaux - Products
Massimo Dutti - Products
Bottegaveneta.com - Products
Ysl.com - Products
Raymourflanigan.com - Products
Mybobs.com - Products
Snapchat posts
Mattressfirm - Products
Sleepnumber.com - Products
Celine.com - Products
Berluti.com - Products
llbean.com - Products
Macys.com
La-z-boy.com - Products
Montblanc - Products
Moynat.com - Products
Costco products
Micro Center Products
B&H Products
Filter the Github dataset with a single prompt
Describe exactly what you need, and let AI apply the perfect filters in seconds.
- Describe data needs in plain English
- AI applies accurate filters automatically
- Narrow huge datasets to only what matters to you
- Cut costs by skipping irrelevant data
- Export filtered data in your preferred format
Maximize value with strategic cost savings
Smart Data Updates
Access only "New Records" or "Updated Records," ensuring you pay only for what you need"
Dataset Bundles
Gain greater value by purchasing two or more datasets together, with exclusive discounts.
Volume Discounts
Get more for less with significant savings when purchasing large datasets or updates subscriptions
Enriched Datasets
Save time and resources with pre-built datasets that combine multiple sources into one clean dataset
Datasets Pricing
- Clean and validated
- Refreshed monthly
- JSON/CSV/Parquet
Power AI Agents Instantly
Our Github datasets are AI/LLM-optimized: clearly structured, well-documented, with code and recipes for easy LLM/chatbot integration.
Structured & Clean
Pre-processed data with consistent schemas, perfect for AI model training and inference.
Code Examples
Ready-to-use Python, Node.js, cURL, PHP, Go, Java, and Ruby snippets for easy integration with AI workflows.
Documentation
curl --request GET
--url https://api.brightdata.com/datasets/snapshots/{id}/download
--header 'Authorization: Bearer '
import requests
url = "https://api.brightdata.com/datasets/snapshots/{id}/download"
headers = {"Authorization": "Bearer "}
response = requests.get(url, headers=headers)
print(response.json())
const url = 'https://api.brightdata.com/datasets/snapshots/{id}/download';
const options = {method: 'GET', headers: {Authorization: 'Bearer '}, body: undefined};
try {
const response = await fetch(url, options);
const data = await response.json();
console.log(data);
} catch (error) {
console.error(error);
}
HttpResponse response = Unirest.get("https://api.brightdata.com/datasets/snapshots/{id}/download")
.header("Authorization", "Bearer ")
.asString();
require 'uri'
require 'net/http'
url = URI("https://api.brightdata.com/datasets/snapshots/{id}/download")
http = Net::HTTP.new(url.host, url.port)
http.use_ssl = true
request = Net::HTTP::Get.new(url)
request["Authorization"] = 'Bearer '
response = http.request(request)
puts response.read_body
GitHub datasets tailored to your needs
Data subscription
Subscribe to access datasets at a significantly reduced cost.
File output formats
JSON, NDJSON, JSON Lines, CSV, Parquet. Optional .gz compression.
Flexible delivery
Snowflake, Amazon S3 bucket, Google Cloud, Azure, and SFTP.
Scalable data
Scale without worrying about infra, proxy servers, or blocks.
Cost savings
Customize any dataset using filters and formatting options.
Code maintenance
Datasets are maintained based on website structure changes.
Simplified integrations
Benefit from integrations with Snowflake and AWS.
24/7 support
A dedicated team of data professionals is here to help.
Leaders in compliance
Data is ethically obtained and compliant with all privacy laws.
Get structured and reliable GitHub data
We’ll provide the data while you focus on the rest
High-volume web data
With our unblocking capabilities and round-the-clock IP rotation we ensure access to all data points on a website.
Data for immediate use
Every aspect of the data collection process is thoroughly validated as part of our robust data validation process.
Automated data flow
Create custom schedules to automate data delivery and watch the data flow seamlessly into your storage.
How companies use GitHub datasets
Developer activity
Community involvement
Improve engagement
Github Dataset FAQs
Can I get updates for my purchased Github dataset?
Yes, you can get updates to your Github dataset on a daily, weekly, monthly, or custom basis.
Can I purchase a subset of the Github dataset?
Yes, you can purchase a Github subset that will include only the data points you need. By purchasing a subset, cost is reduced substantially.
In what format will I receive the Github dataset?
Dataset formats are JSON, NDJSON, JSON Lines, CSV, or Parquet. Optionally, files can be compressed to .gz.
Can I get a data sample?
Yes, you can request sample data to evaluate the quality and relevance of the information provided. This is a great way to ensure it meets your needs before committing to a full dataset.
Can I request specific data points from the Github dataset?
Yes, you can request specific data points from the Github dataset tailored to your unique needs, ensuring you receive precisely the information you require for your projects.
Is it possible to integrate the Github dataset directly into my existing systems?
Absolutely, the Github dataset offers seamless API integration, allowing you to effortlessly integrate the data into your CRM, analytics tools, or any other systems you use, streamlining your operations.