#180 · Primary category: Inference & Local Deploy
Bender
Easily craft fast Neural Networks on iOS! Use TensorFlow models. Metal under the hood.
Project last updated:11/07/23
GitHub Stars
1.8K
Forks
89
Contributors
12
License
MIT
Why we included this project
Bender is a Swift layer over Apple's MetalPerformanceShaders for running pretrained neural networks on iOS. Instead of hand-wiring raw MPSCNN kernels, you assemble a network from standard building blocks like convolution, pooling, fully connected, and normalization layers, or point it at an exported TensorFlow graph and have it translated into Bender layers automatically. That import path avoids bundling TensorFlow's static library and gives you GPU access on iOS, which the TensorFlow build for that platform didn't support. The API chains layer operators in a readable way, and the docs list which TensorFlow ops are supported and how they map to Bender layers, so you can check your model before committing. Small teams doing on-device image recognition or other inference without a heavyweight runtime will find it practical, as long as their models stick to the supported layer set.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.