#27 · Primary category: MLOps & Evaluation
easy-dataset
A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval
Project last updated:05/01/26
GitHub Stars
14.9K
Forks
1.5K
Contributors
37
License
Other
Why we included this project
Anyone who has assembled a fine-tuning or RAG dataset by hand knows the real work is parsing documents, splitting text into sensible chunks, and writing question-answer pairs. Easy Dataset wraps that whole pipeline in a guided desktop and web application. You feed it PDF, Markdown, DOCX, or EPUB files, it applies a few chunking strategies, and an LLM API generates questions, answers, and chain-of-thought content you can review and clean before exporting. Output covers single-turn, multi-turn, and image QA formats, with exports to Alpaca, ShareGPT, and JSONL, plus one-click configuration for LLaMA Factory and direct upload to Hugging Face. If you also need to verify the data, the built-in evaluation side turns documents into test sets and runs automated judging alongside a double-blind human arena. For small teams that want a visual, low-code route from raw domain documents to usable training and evaluation data, this is a practical pick.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, FLUX and more.
LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
netron
Visualizer for neural network, deep learning and machine learning models