Finding Data & Statistics: Data Science

A collection of datasets and data generators used by the machine learning community. Currently has >600 datasets, searchable by data type, task of interest, domain area, and other attributes.

Search by size (GBs), file type, license type, and topic/domain tags.

Database of handwritten digits, with a training set of 60,000 and test set of 10,000 examples. Good dataset for pattern recognition.

Contains nearly 7 million Yelp reviews, plus photos and business attributes.

This compilation of datasets from UCSD's Julian McAuley includes datasets from Amazon, Goodreads, RentTheRunway, Facebook, Twitter, Reddit, and more.

YouTube-8M is a large-scale labeled video dataset that consists of millions of YouTube video IDs, with high-quality machine-generated annotations from a diverse vocabulary of 3,800+ visual entities. The YouTube-8M Segments dataset is an extension of the YouTube-8M dataset with human-verified segment annotations.

The study includes two datasets: 1) Kickstarter Project dataset and 2) Backer Location dataset. The Kickstarter Project dataset contains detailed information about all Kickstarter projects starting in 2009 through 2020, including the project title, project category and subcategory, project location (city, state (for U.S. based projects), and country), funding goal in original and U.S. currencies, pledged amount (in dollars), number of backers for each project, etc. The Kickstarter Project dataset includes data on 506,199 successful and unsuccessful funded projects. The Backer Location dataset includes information about backers' country and state, and the total amount pledged for each geographic location.

Within this guide, under Find Data by Topic/COVID-19. Scroll down to "Social media data"

Includes a variety of network data types, including social networks, networks with ground-truth communities, temporal networks, web graphs, collaboration networks, and more.

An awesome list of resources to construct, analyze and visualize network data. Inspired by Awesome Deep Learning, Awesome Math and others.

As of 2022, contains nearly 7000 machine learning datasets. Filter by data type (image, text, video, audio, etc.)

The Common Crawl corpus contains petabytes of data collected over 12 years of web crawling. The corpus contains raw web page data, metadata extracts and text extracts. Common Crawl data is stored on Amazon Web Services’ Public Data Sets.

Includes a large amount of satellite imagery (LANDSAT, Sentinel-2).

Choose from US government data, statistical/scientific data, and online service data.

This guide from Princeton University Library has links to a variety of face image databases. Note: "Please read the rights, permissions, licensing information on the database's webpage before proceeding with use. Make sure to obtain the permissions required and credit/cite as requested by the creators."

Data Is Plural is a weekly newsletter of useful/curious datasets, published by Jeremy Singer-Vine. This is a great resource for finding data sets that aren't necessarily data science focused per se, but could have a variety of data science applications (recommendation algorithms, predictive analytics, etc.)

Data cleaning is a hugely important part of data science, but it can be hard to find "good" messy datasets to practice your cleaning skills. This site includes datasets that need clearning/organizing/reformatting to be most useful, along with a brief overview of what needs to be fixed in each dataset.