#67 · Primary category: MLOps & Evaluation
transformerlab-app
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.
Project last updated:08/09/26
GitHub Stars
5.2K
Forks
547
Contributors
36
License
AGPL-3.0
Why we included this project
Transformer Lab bundles fine-tuning, evaluation, and inference into one application that runs on your own machine or sends jobs to a Slurm or SkyPilot cluster. You load models like Llama, DeepSeek, Mistral, or Stable Diffusion, train LoRA or QLoRA adapters on Apple Silicon or NVIDIA GPUs, and run built-in benchmarks such as MMLU or LLM judge scoring from the same interface. The individual edition keeps everything local, so no training data leaves your hardware, which matters for labs with privacy constraints and for hobbyists who just want to experiment on a single GPU. A Lab SDK and plugin system lets you reuse existing Python training scripts and get automatic logging and artifact tracking without rewriting them.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, FLUX and more.
LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
netron
Visualizer for neural network, deep learning and machine learning models