#131 · Primary category: LLM Application Frameworks
agentscope-runtime
A production-ready runtime framework for agent apps with secure tool sandboxing, Agent-as-a-Service APIs, scalable deployment, full-stack observability, and broad framework compatibility.
Project last updated:06/04/26
GitHub Stars
861
Forks
167
Contributors
37
License
Apache-2.0
Why we included this project
AgentScope Runtime addresses the gap teams hit once an agent prototype outgrows a notebook: running tool calls safely and exposing the agent as an actual service. Tool execution goes through a hardened sandbox, so the Python, shell, browser, and filesystem operations an LLM invokes run in an isolated environment rather than with full host privileges, and an Agent-as-a-Service layer streams responses over SSE. Deployment is handled by a DeployManager that works locally, on Kubernetes, or serverless, and logs and traces give you visibility into what agents actually do in production. The honest caveat is that the repo is now archived and read-only, since these capabilities moved into AgentScope 2.0, so anyone starting fresh should build on that project. Still, teams studying how a production agent runtime is structured, or those staying on the standalone package, will find the design decisions worth reading.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
langchain
The agent engineering platform.
dify
Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
headroom
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
llama_index
LlamaIndex is the leading document agent and OCR platform