#141 · Primary category： Inference & Local Deploy
kronk
Your personal engine for running open source models locally. Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stablediffusion.cpp directly integrated into your Go applications. Kronk provides a high-level API and a model server.
Project last updated：08/29/26
GitHub Stars
767
Forks
55
Contributors
12
License
Apache-2.0
Why we included this project
Kronk is a Go SDK and model server that lets you run open models locally without standing up a Python-based serving stack. It wraps llama.cpp, whisper.cpp, and stable-diffusion.cpp behind a high-level API, covering text, vision, embeddings, reranking, speech-to-text, and experimental image generation. The server exposes OpenAI-compatible endpoints for chat, embeddings, reranking, and transcription, plus an Anthropic-compatible Messages API, so existing tools can point at local models with minimal changes. A browser UI, model management, and integrations with OpenWebUI, OpenCode, and Claude Code round it out, making it a self-contained inference hub rather than a bare library. For Go teams that want a single binary for on-prem or edge deployment, the automatic download of native libraries and model files is a nice touch.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
llama.cpp
LLM inference in C/C++
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.