Discover / LLM Ops & Observability

OpenLLMetry

by traceloopPython

OpenTelemetry-based observability for LLM apps by Traceloop.

Toolexperimental

Maturity: experimental because latest release 0.62.1 is pre 1.0. Derived from release and commit history, not a rating.

Stars
7.3k
Forks
1.0k
Downloads / mo
Last commit
2026-07-13
License
Apache-2.0
Open issues
617

Market and trust evidence

Edition not yet matched

No exact skills.sh identity match is available for this repository. Repository adoption and freshness remain visible above; install momentum is not inferred.

Trust analysis is a screening signal, not a security warranty. Read the ranking and trust methodology.

In practice

Written by AI from this repository’s README · high confidence

LLM calls are a black box to the APM you already run, because there is no standard instrumentation for them.

Use it when

Use it when you already have Datadog, Honeycomb, Grafana or another OTel destination and want LLM traces there.

Not the right pick when

This repo is the Python side; the README points JS and TypeScript users to the separate OpenLLMetry-JS project.

Capabilities

  • standard OpenTelemetry instrumentations for LLM providers
  • instrumentations for vector databases
  • Traceloop SDK initialised with a single init call
  • outputs standard OpenTelemetry data to existing observability tools
  • option to disable batch sending to see local traces immediately

Cost: Free and open source

Video walkthroughs

Third-party YouTube uploads matched to this tool by title, channel and repository name on 2026-08-03. Not made, reviewed or endorsed by SkillPilot. View counts and publish months are as of the match date and the month is approximate. Nothing loads from YouTube until you press play.

What the repository ships

Ships CLAUDE.mdSecurity policyCI configured

Detected from the actual files in the repository root.

Latest release 0.62.1

Published 2026-06-28

v0.62.1 (2026-06-28)

Fix

  • bump version problem (#4332)

[main 93429cfb9] bump: version 0.62.0 → 0.62.1

64 files changed, 69 insertions(+), 63 deletions(-)

Tags

README

<p align="center">

<a href="https://www.traceloop.com/openllmetry#gh-light-mode-only">

<img width="600" src="https://raw.githubusercontent.com/traceloop/openllmetry/main/img/logo-light.png">

</a>

<a href="https://www.traceloop.com/openllmetry#gh-dark-mode-only">

<img width="600" src="https://raw.githubusercontent.com/traceloop/openllmetry/main/img/logo-dark.png">

</a>

</p>

<p align="center">

<p align="center">Open-source observability for your LLM application</p>

</p>

<h4 align="center">

<a href="https://traceloop.com/docs/openllmetry/getting-started-python"><strong>Get started »</strong></a>

<br />

<br />

<a href="https://traceloop.com/slack">Slack</a> |

<a href="https://traceloop.com/docs/openllmetry/introduction">Docs</a> |

<a href="https://www.traceloop.com/openllmetry">Website</a>

</h4>

<h4 align="center">

<a href="https://github.com/traceloop/openllmetry/releases">

<img src="https://img.shields.io/github/release/traceloop/openllmetry">

</a>

<a href="https://pepy.tech/project/opentelemetry-instrumentation-openai">

<img src="https://static.pepy.tech/badge/opentelemetry-instrumentation-openai/month">

</a>

<a href="https://github.com/traceloop/openllmetry/blob/main/LICENSE">

<img src="https://img.shields.io/badge/license-Apache 2.0-blue.svg" alt="OpenLLMetry is released under the Apache-2.0 License">

</a>

<a href="https://github.com/traceloop/openllmetry/actions/workflows/ci.yml">

<img src="https://github.com/traceloop/openllmetry/actions/workflows/ci.yml/badge.svg">

</a>

<a href="https://github.com/traceloop/openllmetry/issues">

<img src="https://img.shields.io/github/commit-activity/m/traceloop/openllmetry" alt="git commit activity" />

</a>

<a href="https://www.ycombinator.com/companies/traceloop"><img src="https://img.shields.io/website?color=%23f26522&down_message=Y%20Combinator&label=Backed&logo=ycombinator&style=flat-square&up_message=Y%20Combinator&url=https%3A%2F%2Fwww.ycombinator.com"></a>

<a href="https://github.com/traceloop/openllmetry/blob/main/CONTRIBUTING.md">

<img src="https://img.shields.io/badge/PRs-Welcome-brightgreen" alt="PRs welcome!" />

</a>

<a href="https://traceloop.com/slack">

<img src="https://img.shields.io/badge/chat-on%20Slack-blueviolet" alt="Slack community channel" />

</a>

<a href="https://twitter.com/traceloopdev">

<img src="https://img.shields.io/badge/follow-%40traceloopdev-1DA1F2?logo=twitter&style=social" alt="Traceloop Twitter" />

</a>

</h4>

🎉 New:

Our semantic conventions are now part of OpenTelemetry! Join the discussion and help us shape the future of LLM observability.

Looking for the JS/TS version? Check out OpenLLMetry-JS.

OpenLLMetry is a set of extensions built on top of OpenTelemetry that gives you complete observability over your LLM application. Because it uses OpenTelemetry under the hood, it can be connected to your existing observability solutions - Datadog, Honeycomb, and others.

It's built and maintained by Traceloop under the Apache 2.0 license.

The repo contains standard OpenTelemetry instrumentations for LLM providers and Vector DBs, as well as a Traceloop SDK that makes it easy to get started with OpenLLMetry, while still outputting standard OpenTelemetry data that can be connected to your observability stack.

If you already have OpenTelemetry instrumented, you can just add any of our instrumentations directly.

🚀 Getting Started

The easiest way to get started is to use our SDK.

For a complete guide, go to our docs.

Install the SDK:


pip install traceloop-sdk

Then, to start instrumenting your code, just add this line to your code:


from traceloop.sdk import Traceloop

Traceloop.init()

That's it. You're now tracing your code with OpenLLMetry!

If you're running this locally, you may want to disable batch sending, so you can see the traces immediately:


Traceloop.init(disable_batch=True)

⏫ Supported (and tested) destinations

See our docs for instructions on connecting to each one.

🪗 What do we instrument?

OpenLLMetry can instrument everything that OpenTelemetry already instruments - so things like your DB, API calls, and more. On top of that, we built a set of custom extensions that instrument things like your calls to OpenAI or Anthropic, or your Vector DB like Chroma, Pinecone, Qdrant or Weaviate.

Vector DBs

Frameworks

Protocol

🔎 Telemetry

We no longer log or collect any telemetry in the SDK or in the instrumentations. Make sure to bump to v0.49.2 and above.

Why we collect telemetry

  • The primary purpose is to detect exceptions within instrumentations. Since LLM providers frequently update their APIs, this helps us quickly identify and fix any breaking changes.
  • We only collect anonymous data, with no personally identifiable information. You can view exactly what data we collect in our Privacy documentation.
  • Telemetry is only collected in the SDK. If you use the instrumentations directly without the SDK, no telemetry is collected.

🌱 Contributing

Whether big or small, we love contributions ❤️ Check out our guide to see how to get started.

Not sure where to get started? You can:

  • Book a free pairing session with one of our teammates!
  • Join our <a href="https://traceloop.com/slack">Slack</a>, and ask us any questions there.

💚 Community & Support

  • Slack (For live discussion with the community and the Traceloop team)
  • GitHub Discussions (For help with building and deeper conversations about features)
  • GitHub Issues (For any bugs and errors you encounter using OpenLLMetry)
  • Twitter (Get news fast)

🙏 Special Thanks

To @patrickdebois, who suggested the great name we're now using for this repo!

💫 Contributors

<a href="https://github.com/traceloop/openllmetry/graphs/contributors">

<img alt="contributors" src="https://contrib.rocks/image?repo=traceloop/openllmetry"/>

</a>

Related tools