#8 · Primary category: Synthetic Data Generation
curator
Synthetic data curation for post-training and structured data extraction
Project last updated:08/07/26
GitHub Stars
1.7K
Forks
146
Contributors
23
License
Apache-2.0
Why we included this project
Most teams find assembling post-training data is where fine-tuning actually gets hard, and Curator targets that step directly. You write a plain Python function that calls a model, and the library runs those calls across thousands of rows for you, handling batching, caching, and fault recovery in the background, so generating reasoning traces, instruction pairs, or structured JSON doesn't mean babysitting a long job. The same pipeline doubles as structured data extraction, so one interface serves both a team preparing training data and a team pulling JSON out of messy documents. If you're distilling a strong model into a smaller one or putting together an SFT or RLHF set, this is a solid practical starting point.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
SDV
Synthetic data generation for tabular data
distilabel
Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.
kubric
A data generation pipeline for creating semi-realistic synthetic multi-object videos with rich annotations such as instance segmentation masks, depth maps, and optical flow.
synthetic-data-generator
SDG is a specialized framework designed to generate high-quality structured tabular data.
UltraChat
Large-scale, Informative, and Diverse Multi-round Chat Data (and Models)