#8 · Primary category: Synthetic Data Generation

curator

agents deep-learning fine-tuning instruction-tuning llm machine-learning natural-language-processing prompt python synthetic-data synthetic-dataset-generation

Synthetic data curation for post-training and structured data extraction

Project last updated:08/07/26

GitHub Stars

1.7K

Forks

146

Contributors

23

License

Apache-2.0

Why we included this project

Most teams find assembling post-training data is where fine-tuning actually gets hard, and Curator targets that step directly. You write a plain Python function that calls a model, and the library runs those calls across thousands of rows for you, handling batching, caching, and fault recovery in the background, so generating reasoning traces, instruction pairs, or structured JSON doesn't mean babysitting a long job. The same pipeline doubles as structured data extraction, so one interface serves both a team preparing training data and a team pulling JSON out of messy documents. If you're distilling a strong model into a smaller one or putting together an SFT or RLHF set, this is a solid practical starting point.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category