#111 · Primary category: MLOps & Evaluation
training
Reference implementations of MLPerf® training benchmarks
Project last updated:08/17/26
GitHub Stars
1.8K
Forks
593
Contributors
73
License
Apache-2.0
Why we included this project
Comparing how fast different systems finish a training run sounds simple, but it only works if everyone runs the same workload. This repo collects the official MLPerf training reference implementations, each with model code, a Dockerfile, dataset download steps, and a script that times the run. That means a team shopping for GPUs or checking a new accelerator can clone a benchmark and get results directly comparable to what vendors and research papers report. The maintainers are upfront that these are starting points, not fully optimized code, so they are meant for measuring relative performance rather than for production training. For anyone who needs a widely recognized, reproducible workload to benchmark against, these implementations give you a fair baseline without having to build one from scratch.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, FLUX and more.
LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
netron
Visualizer for neural network, deep learning and machine learning models