#1 · Primary category: MLOps & Evaluation
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, FLUX and more.
Project last updated:08/29/26
GitHub Stars
75.2K
Forks
6.8K
Contributors
300
License
Apache-2.0
Why we included this project
Fine-tuning an open model on your own hardware usually means wrestling with VRAM limits and long training runs. Unsloth tackles that directly with optimized kernels for models like Llama, Qwen, Gemma, and DeepSeek, cutting memory use and speeding up training noticeably. The current release also adds a local web UI for downloading, running, and exporting models to formats like GGUF, alongside notebook workflows and a one-command install that make iterating fast. It covers training through local inference, including API endpoints for wiring the fine-tuned model into other tools. If you'd rather own the fine-tuning step than depend on hosted APIs, this is a solid place to start.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
netron
Visualizer for neural network, deep learning and machine learning models
mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.