#84 · Primary category: LLM Application Frameworks
any-llm
Communicate with an LLM provider using a single interface
Project last updated:08/26/26
GitHub Stars
2.2K
Forks
216
Contributors
62
License
Apache-2.0
Why we included this project
Python teams that have built their service against one model provider often discover switching is painful. any-llm offers a single completion call that can talk to OpenAI, Anthropic, Azure, Mistral, Ollama, and others, so moving providers means changing a provider name and setting the right environment key instead of rewriting request code. It deliberately follows LiteLLM's conventions, so API keys and environment variables from an existing setup carry over unchanged and migration stays cheap. The library is for developers embedding model calls into their own applications, not for end users chatting with a bot. If you are early in a build and want to keep provider options open without committing to per-provider client code, this gives you a thin layer to build on and swap out later.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
langchain
The agent engineering platform.
dify
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
headroom
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
llama_index
LlamaIndex is the leading document agent and OCR platform