Dataset GitHub Repositories

A collective list of free APIs

Label Studio is a multi-type data labeling and annotation tool with standardized output format

1,324-exercise fitness dataset — animation GIFs, 180×180 thumbnails, muscle-group & equipment data, and step-by-step instructions in 6 languages. The exercise data layer behind the LogPress app.

Faker is a Python package that generates fake data for you.

Computer Vision Annotation Tool (CVAT) is a leading platform for building high-quality visual datasets for vision AI. It offers open-source, cloud, and enterprise products, as well as labeling services, for image, video, and 3D annotation with AI-assisted labeling, quality assurance, team collaboration, analytics, and developer APIs.

pix2tex: Using a ViT to convert images of equations into LaTeX code.

A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

A MNIST-like fashion product database. Benchmark :point_down:

Open source annotation tool for machine learning practitioners.

Techniques for deep learning with satellite & aerial imagery

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

Curated list of Machine Learning, NLP, Vision, Recommender Systems Project Ideas

Browser compatibility data for Web technologies as displayed on MDN

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

Curated list of datasets and tools for post-training.

esProc SPL is a JVM-based programming language designed for structured data computation, serving as both a data analysis tool and an embedded computing engine.

Transformer: PyTorch Implementation of "Attention Is All You Need"

TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

中文人名语料库。人名生成器。中文姓名,姓氏,名字,称呼,日本人名,翻译人名,英文人名。可用于中文分词、人名实体识别。

SQL Translator is a tool for converting natural language queries into SQL code using artificial intelligence. This project is 100% free and open source.

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

📈 目前最大的工业缺陷检测数据库及论文集 Constantly summarizing open source dataset and critical papers in the field of surface defect research which are of great importance.

CSGHub is a brand-new open-source platform for managing LLMs, developed by the OpenCSG team. It offers both open-source and on-premise/SaaS solutions, with features comparable to Hugging Face. Gain full control over the lifecycle of LLMs, datasets, and agents, with Python SDK compatibility with Hugging Face. Join us! ⭐️

Paper list and datasets for industrial image anomaly/defect detection (updating). 工业异常/瑕疵检测论文及数据集检索库(持续更新)。

A synthetic data generator for text recognition

医学影像数据集列表 『An Index for Medical Imaging Datasets』

Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops 🦖

A quick guide (especially) for trending instruction finetuning datasets

Waymo Open Dataset