#147 · Primary category: LLM Application Frameworks
nextpy
🤖Self-Modifying Framework from the Future 🔮 World's First AMS
Project last updated:05/01/24
GitHub Stars
2.3K
Forks
181
Contributors
13
License
Apache-2.0
Why we included this project
Nextpy is a pure-Python framework for developers building AI applications where the model itself influences the app's code and behavior. Its core is a compile-time prompt engine that gives you structured, typed control over LLM output: guardrails that define what the model can and cannot do, exact response schemas, session state with reused KV caches, and speculative sampling to speed up generation on open-source models. That focus on deterministic output makes it a better fit for agent backends and code-generation tools than for a general-purpose chatbot. It also includes a generative UI layer, so you can build the front end of an agentic app without leaving Python. The project is still explicitly an experiment, marked as being in the "just for friends" stage, so treat it as something to prototype with and test against your own prompt-heavy workloads, not a battle-tested platform.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
langchain
The agent engineering platform.
dify
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
headroom
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
llama_index
LlamaIndex is the leading document agent and OCR platform