#12 · Primary category: Inference & Local Deploy
modular
The Modular Platform (includes MAX & Mojo)
Project last updated:08/29/26
GitHub Stars
29.3K
Forks
3.1K
Contributors
464
License
Other
Why we included this project
The MAX half of this platform is what most teams will reach for first: install it with pip or conda and you get an OpenAI-compatible inference endpoint, and the Kubernetes-ready containers deploy the same model on NVIDIA or AMD GPUs with a single command. The repo also holds the MAX model pipelines and a large set of CPU and GPU kernels, so it works as a reference for how modern serving and kernel code is put together. Mojo developers get the language's standard library and examples here too, which helps if you want to write custom kernels or low-level AI code. It's a broad, actively maintained codebase rather than a turnkey product, so budget time for the docs before you expect a finished app.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.