#44 · Primary category： Inference & Local Deploy
GenieX
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
Project last updated：08/28/26
GitHub Stars
8.3K
Forks
1.0K
Contributors
20
License
BSD-3-Clause
Why we included this project
If your software targets Qualcomm Snapdragon devices, GenieX gives you a single on-device inference runtime that runs GGUF models from Hugging Face or pre-compiled bundles from Qualcomm AI Hub on the Hexagon NPU, Adreno GPU, or CPU. The C core is exposed through a CLI, Python bindings, Kotlin/Java for Android, Docker, and an OpenAI-compatible local server, so you can switch interfaces without touching the model layer. That makes it a practical fit for offline or privacy-sensitive mobile and edge apps that need frontier LLMs or vision-language models running locally. It also includes sample Android apps, which helps when prototyping an on-device assistant that still talks to existing tooling.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.