#25 · Primary category： Data Annotation & Labeling Tools
finetune_dataset_maker
Fine-tuning dataset generator for ChatGLM, create your own catgirl.
Project last updated：02/25/24
GitHub Stars
603
Forks
73
Contributors
1
License
MIT
Why we included this project
This is a small Streamlit app for people putting together instruction-tuning data for ChatGLM-style models. You load your questions from a plain text file, then either write the answers yourself or have the OpenAI API stream a draft you can review before moving on. Finished pairs are saved locally and export to the JSON formats used by several popular ChatGLM fine-tuning projects, so the output feeds straight into training. It is deliberately narrow, a single-purpose tool rather than a platform, which suits hobbyists and small teams building a personal or niche model. One caveat: it expects the older openai package (0.28.0) and assumes a proxy setup if you are outside the supported network.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
doccano
Open source annotation tool for machine learning practitioners.
X-AnyLabeling
X-AnyLabeling: A lightweight, efficient, and unified cross-platform desktop application for annotating text, image, video, and multimodal data, combining versatile built-in tools with state-of-the-art AI models and flexible multi-format export.
snorkel
A system for quickly generating training data with weak supervision
argilla
Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
anylabeling
Effortless AI-assisted data labeling with AI support from YOLO, Segment Anything (SAM+SAM2/2.1+SAM3), MobileSAM!!