#114 · Primary category： LLM Application Frameworks
ollama-rs
A simple and easy-to-use library for interacting with the Ollama API.
Project last updated：08/19/26
GitHub Stars
1.1K
Forks
166
Contributors
61
License
MIT
Why we included this project
For Rust developers who want local LLM access from their own applications, ollama-rs wraps the Ollama API into typed functions, so streaming completions, chat, model management, embeddings, and tool calls all happen inside your binary. The crate stays small, which makes it a practical client layer for embedding a local model into a larger program rather than running a separate service. You get the official examples showing a working chatbot in fewer than fifty lines, and you avoid maintaining hand-written HTTP glue against Ollama's endpoints. It's not a model runtime; it connects your Rust code to an already running Ollama instance.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
langchain
The agent engineering platform.
dify
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
headroom
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
llama_index
LlamaIndex is the leading document agent and OCR platform