#33 · Primary category： LLM Application Frameworks
llm
Access large language models from the command-line
Project last updated：08/22/26
GitHub Stars
12.4K
Forks
966
Contributors
68
License
Apache-2.0
Why we included this project
Simon Willison's LLM puts dozens of language models behind one command-line tool and Python library. You plug in a provider, run `llm` from a shell, and get the same style of output whether the model lives at OpenAI, Anthropic, or in a local install you manage yourself. Prompts and responses land in a SQLite database, which makes it easy to review what you ran and pull out embeddings or structured data later. That combination suits shell scripts, batch jobs, and anyone tired of losing experiments in a chat window. Teams that move between providers without wanting to rewrite their glue code will find the plugin system keeps the swap cheap.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
langchain
The agent engineering platform.
dify
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
headroom
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
llama_index
LlamaIndex is the leading document agent and OCR platform