#78 · Primary category： Inference & Local Deploy
ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
Project last updated：08/29/26
GitHub Stars
3.0K
Forks
360
Contributors
140
License
MIT
Why we included this project
RamaLama brings local AI inference into the container workflows that Podman and Docker users already live in. Instead of hand-tuning the host for whatever GPU you happen to have, you pull a model from a registry, including OCI registries, and the tool selects a container image matched to the acceleration hardware it detects on your machine. Dependency handling and hardware optimization happen inside that image, so there is no host configuration left to you. It is a practical fit for developers and small teams that want reproducible, portable inference on local or on-prem hardware without standing up a separate heavyweight serving stack.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.