#55 · Primary category: AI Gateway & API Infrastructure
router
Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just an endpoint change.
Project last updated:08/30/26
GitHub Stars
2.9K
Forks
82
Contributors
10
License
Other
Why we included this project
Most agent teams end up pointing Claude Code, Codex, Cursor, or their own custom agents at a mix of providers, and the cheapest model is rarely the right one for every turn. Router sits in front of Anthropic, OpenAI, and Gemini. Rather than guessing from prompt text, it embeds each action and scores it against a cluster model, then forwards the request to the cheapest model that fits among the providers you configure, OpenRouter and OpenAI-compatible endpoints included. You do not have to change your tooling either: repoint existing agents at a localhost endpoint and the project claims 40-70% savings from that change alone. Because it speaks each backend's native API and keeps provider keys on your machine, you avoid funneling traffic through a third-party proxy. Teams that are cautious about the operational overhead can test the self-hosted stack, dashboard, and OTLP tracing against their real agent workloads before committing.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
OmniRoute
Open-source AI gateway: one endpoint, 290+ providers (90+ free), 500+ models, auto-fallback, token compression, MCP/A2A, works with Claude Code, Codex, Cursor, Cline, Copilot.
CLIProxyAPI
Wrap Antigravity, ChatGPT Codex, Claude Code, Grok Build as an OpenAI/Gemini/Claude/Codex compatible API service, allowing you to enjoy the free Gemini 3.1 Pro, GPT 5.6 Series, Grok 4.5, Claude model through API
kong
🦍 The API and AI Gateway
novu
The open-source communication infrastructure for agents and products
GPT_API_free
Free API for large models, supports GPT, DeepSeek, etc., 10k free points daily, paid plans at 10-20% of official price.