LLM Application Frameworks
Frameworks for building LLM applications — LangChain-class tooling.
148 projects
See methodology for ranking rules; order uses public GitHub metrics within this scenario.
| Rank | Project | Stars | Forks | Updated | License |
|---|---|---|---|---|---|
| 61 |
rust-sdk
The official Rust SDK for the Model Context Protocol |
3.9K | 626 | 08/29/26 | Other |
| 62 |
csharp-sdk
The official C# SDK for Model Context Protocol servers and clients. Maintained in collaboration with Microsoft. |
4.5K | 797 | 08/27/26 | Other |
| 63 |
atmosphere
Portable AI agent runtime for the JVM. One @Agent class runs on Spring AI, LangChain4j, Anthropic, or 9 more behind one SPI. Token streaming, tool calls, human approvals, and governance over WebSocket, SSE, gRPC, or WebTransport/HTTP3. Speaks MCP, A2A, and AG-UI. |
3.8K | 760 | 08/30/26 | Apache-2.0 |
| 64 |
h2o-llmstudio
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/ |
5.2K | 556 | 08/18/26 | Apache-2.0 |
| 65 |
embabel-agent
Agent framework for the JVM. Pronounced Em-BAY-bel /ɛmˈbeɪbəl/ |
4.4K | 430 | 08/29/26 | Apache-2.0 |
| 66 |
langroid
Harness LLMs with Multi-Agent Programming |
4.1K | 395 | 08/29/26 | MIT |
| 67 |
GenerativeAIExamples
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture. |
4.2K | 1.1K | 08/20/26 | Apache-2.0 |
| 68 |
LazyLLM
Easiest and laziest way for building multi-agent LLMs applications. |
3.9K | 408 | 08/27/26 | Apache-2.0 |
| 69 |
java-sdk
The official Java SDK for Model Context Protocol servers and clients. Maintained in collaboration with Spring AI |
3.7K | 1.1K | 08/28/26 | MIT |
| 70 |
LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently. |
3.8K | 506 | 08/24/26 | MIT |
| 71 |
cascadeflow
Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop. |
4.0K | 911 | 08/27/26 | MIT |
| 72 |
fastmcp
A TypeScript framework for building MCP servers. |
3.3K | 305 | 08/29/26 | MIT |
| 73 |
ai
🤖 Type-safe, provider-agnostic TypeScript AI SDK for streaming chat, tool calling, agents, and multimodal apps across OpenAI, Anthropic, Gemini, React, Vue, Svelte, and Solid. |
3.0K | 312 | 08/29/26 | MIT |
| 74 |
Gemini-API
✨ Reverse-engineered Python API for Google Gemini web app |
3.5K | 548 | 08/27/26 | AGPL-3.0 |
| 75 |
docetl
A system for agentic LLM-powered data processing and ETL |
4.1K | 438 | 08/10/26 | MIT |
| 76 |
llm-workflow-engine
Power CLI and Workflow manager for LLMs (core package) |
3.7K | 468 | 08/14/26 | MIT |
| 77 |
ax
The pretty much "official" DSPy framework for Typescript |
2.9K | 191 | 08/29/26 | Apache-2.0 |
| 78 |
erupt
why write many code when few annotation do trick — annotation-driven Java framework, one class become full admin, now with built-in AI harness too |
2.8K | 512 | 08/29/26 | Apache-2.0 |
| 79 |
nitrostack
The full-stack TypeScript framework to build, test, and deploy production-ready MCP servers and AI-native apps. |
2.5K | 1.4K | 08/28/26 | Apache-2.0 |
| 80 |
burr
Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure. |
2.5K | 189 | 08/29/26 | Apache-2.0 |