#20 · Primary category: AI DevOps & SRE Tools
openllmetry
Open-source observability for your GenAI or LLM application, based on OpenTelemetry
Project last updated:08/10/26
GitHub Stars
7.4K
Forks
1.1K
Contributors
110
License
Apache-2.0
Why we included this project
When you run LLM features in production, you often can't see what's happening inside a model call. How many tokens did that request use? Which provider responded slowly? Did an automatic retry double your bill? OpenLLMetry fixes that by adding OpenTelemetry instrumentation to the SDKs you already have, so telemetry for prompts, token counts, latency, and provider calls shows up without you writing exporters. Because it outputs standard OpenTelemetry data, it feeds into Datadog, Grafana, Honeycomb, or Sentry instead of forcing a new dashboard on you. That's handy for small teams that want to keep their monitoring stack and still see what live model calls are doing, and for engineers tracking down slow responses or unexpected token usage.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
harness
Harness Open Source is an end-to-end developer platform with Source Control Management, CI/CD Pipelines, Hosted Developer Environments, and Artifact Registries.
nx
The Monorepo Platform that amplifies both developers and AI agents. Nx optimizes your builds, scales your CI, and fixes failed PRs automatically. Ship in half the time.
jenkins
Jenkins automation server
awx
AWX provides a web-based user interface, REST API, and task engine built on top of Ansible. It is one of the upstream projects for Red Hat Ansible Automation Platform.
dagger
Automation engine to build, test and ship any codebase. Runs locally, in CI, or directly in the cloud