#124 · Primary category: Inference & Local Deploy
mleap
MLeap: Deploy ML Pipelines to Production
Project last updated:07/21/26
GitHub Stars
1.5K
Forks
316
Contributors
87
License
Apache-2.0
Why we included this project
MLeap tackles a familiar pain: a trained Spark or Scikit-learn pipeline that works well in a notebook but is hard to serve behind a real API. It serializes those pipelines into a portable Bundle format, and a lightweight Scala runtime executes the result on the JVM with no Spark, sklearn, numpy, or pandas in sight. You train once, export, and then either score in a realtime service or load the same bundle back into Spark for batch runs. Because the format spans Spark, PySpark, Scikit-learn, and TensorFlow, teams can mix transformers from different frameworks in one pipeline instead of committing to a single stack or cloud vendor. If your serving layer is JVM-based, this gives you one common way to run research pipelines in production without reimplementing them.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.