#68 · Primary category: Inference & Local Deploy
jetson-containers
Machine Learning Containers for NVIDIA Jetson and JetPack-L4T
Project last updated:08/10/26
GitHub Stars
4.8K
Forks
845
Contributors
81
License
Other
Why we included this project
Running modern AI tooling on a Jetson edge device often means chasing CUDA versions, JetPack releases, and broken wheels. This project sidesteps that with a modular container build system that produces pre-built Docker images for Jetson, covering the usual ML libraries like PyTorch and TensorFlow plus heavier serving stacks such as vLLM, SGLang, llama.cpp, and Whisper. Instead of maintaining your own Dockerfiles and fighting ARM and CUDA toolchains, you pull a container matched to your hardware and JetPack release and get straight to work. Teams doing on-device inference, computer vision, edge LLM serving, or ROS robotics get tested images and reproducible build recipes they can rely on. The repo also works as a handy reference for which package versions work on which Jetson when you are planning a deployment.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.