#159 · Primary category: Inference & Local Deploy
uTensor
TinyML AI inference library
Project last updated:05/10/25
GitHub Stars
1.9K
Forks
250
Contributors
20
License
Apache-2.0
Why we included this project
uTensor targets a world most ML tooling ignores: getting inference to run on Cortex-M microcontrollers, where a model has to fit into tight flash and RAM budgets. The workflow is straightforward if you already train in TensorFlow. It translates a trained model into generated C++11 code you drop straight into an embedded project, so the device runs inference on its own with nothing in the cloud. The core runtime stays around 2 KB, and the reworked API leans on compile-time checks, explicit memory ownership through allocators, and a graph you can step through in GDB rather than treating as a black box. If you want to see how a real inference runtime.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.