#128 · Primary category: MLOps & Evaluation

GraphGen

ai4science data-generation data-synthesis graphgen knowledge-graph llama-factory llm llm-training pretrain pretraining qa question-answering qwen sft sft-data xtuner

GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation

Project last updated:08/17/26

GitHub Stars

1.2K

Forks

97

Contributors

13

License

Apache-2.0

Why we included this project

GraphGen tackles a common bottleneck in fine-tuning: getting enough good instruction data. It builds a knowledge graph from your source material and uses it to generate question-answer pairs that fit supervised fine-tuning directly, so you don't have to rely on random samples or hand-write every example. If you're already working with Qwen, Llama, or similar models through LLaMA-Factory or XTuner, the output drops straight into your pipeline. It's particularly useful when you need a lot of domain-specific QA data, and the accompanying paper and cookbook explain the method in detail. For anyone trying to give a smaller model more depth in a specific field, this is a straightforward way to expand the training set.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category