#152 · Primary category: Inference & Local Deploy
hummingbird
Hummingbird compiles trained ML models into tensor computation for faster inference.
Project last updated:07/17/25
GitHub Stars
3.5K
Forks
292
Contributors
40
License
MIT
Why we included this project
Hummingbird takes trained classical models, the kind you build with scikit-learn, LightGBM, or XGBoost, and rewrites them as tensor computations that run on PyTorch, TorchScript, ONNX, or TVM. That opens up hardware acceleration and whatever optimizations those frameworks add later, without asking you to retrain or re-engineer anything. The inference API follows scikit-learn's shape, so a compiled model often drops into existing serving code unchanged. For teams that would rather support one deployment stack for both tree-based and neural models, or that need more throughput from mature gradient-boosted pipelines, this is a low-friction way to get it.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.