#28 · Primary category: AI Gateway & API Infrastructure

plano

ai-gateway ai-gateway-support envoy envoyproxy gateway generative-ai llm-gateway llm-inference llm-proxy llm-routing llmops llms openai prompt proxy proxy-server routing

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

Project last updated:08/19/26

GitHub Stars

7.0K

Forks

487

Contributors

43

License

Apache-2.0

Why we included this project

Plano is an out-of-process proxy that handles the plumbing most multi-agent apps end up re-implementing by hand. You declare agents and providers in YAML, and it takes over routing, orchestration, safety filters, and OpenTelemetry traces, so those concerns don't get scattered through application and framework code. Because agents only need a standard OpenAI-compatible chat endpoint, it works with whatever language or stack you already use, and you can add a new agent or switch providers by alias without touching application code. It is a good fit for teams that want low-latency control over their data plane and consistent moderation and observability across every agent.

Articles for this project

No articles for this project yet.

To suggest a topic or contribute an article, contact us.

Related projects in this category