#43 · Primary category: MLOps & Evaluation
oumi
Easily fine-tune, evaluate and deploy Qwen, Gemma, or any open weight LLM!
Project last updated:08/28/26
GitHub Stars
9.4K
Forks
787
Contributors
52
License
Apache-2.0
Why we included this project
Oumi is a practical pick when your team works with open-weight models and doesn't want to maintain separate toolchains for each stage of the model lifecycle. It handles fine-tuning (SFT, LoRA, DPO, GRPO) on families like Qwen, Gemma, gpt-oss, and DeepSeek-R1, then lets you benchmark, generate synthetic training data, and deploy to vLLM or llama.cpp from the same YAML configuration. That config works on a laptop or a multi-node cluster, which keeps experiments reproducible. It also ships a recipe library and LLM-as-a-judge evaluation helpers, and it builds on vLLM, TRL, and Transformers instead of replacing them, so it drops into existing stacks. For small engineering teams, the cloud job launcher and deploy CLI cover the path from research to production without extra infrastructure glue.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, FLUX and more.
LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
netron
Visualizer for neural network, deep learning and machine learning models