#6 · Primary category: MLOps & Evaluation
mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
Project last updated:08/29/26
GitHub Stars
27.7K
Forks
6.2K
Contributors
1.2K
License
Apache-2.0
Why we included this project
When you're running LLM apps and agents in production, you need to see what they're actually doing, and MLflow gives you that in one open-source tool. It records full traces of agent and LLM calls, runs evaluations with built-in metrics and LLM judges, and keeps an eye on quality and cost over time so problems surface before users hit them. It also still handles the classic ML workflow: experiment tracking, a model registry, and deployment to batch or real-time serving on Kubernetes, SageMaker, and similar targets. That breadth makes it a practical default for small teams that want tracing, evaluation, monitoring, and model management in one place instead of stitching together several point solutions, and it plugs into OpenTelemetry and most major agent frameworks and model providers without forcing a rewrite.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, FLUX and more.
LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
netron
Visualizer for neural network, deep learning and machine learning models