Submit projectSubmit

OpenLLMetry

www.traceloop.com

Traceloop's open-source set of OpenTelemetry extensions that trace LLM calls, vector databases and agent frameworks and send the data to Traceloop or an existing observability backend.

Evaluation & Benchmarks

Save privately. Follow for reviewed updates in your SOTA inbox. Neither changes the ranking.

Your workspace

About OpenLLMetry

LLM calls, vector database queries and agent steps are hard to debug in production when they do not show up in the tracing tools a team already uses.

Who it’s for

  • Teams already running OpenTelemetry who want LLM and vector database calls in the same traces as the rest of their stack
  • Developers of Python or TypeScript LLM apps who want tracing with a single SDK init call and a choice of backend such as Datadog, Grafana or Honeycomb

When to consider it

Consider OpenLLMetry when you want vendor-neutral, Apache-2.0 instrumentation for LLM apps that emits standard OpenTelemetry data, so you can keep your current observability backend instead of adopting a new one.

Tradeoffs & limitations

  • OpenLLMetry only instruments and exports traces; dashboards, evaluations and storage come from the backend you send data to. Traceloop's hosted platform is free up to 50,000 spans a month with 24 hours of data retention, and larger volumes need the Enterprise plan.
  • Traceloop announced in March 2026 that it is joining ServiceNow, and ServiceNow said in May 2026 the acquisition was completed; Traceloop says OpenLLMetry will remain open source and that existing customers will be told of roadmap changes in advance.

SOTA overview · Documentation-based assessment · Sources & review method

Updates

No updates shared yet.

Discussion

Newest first

Ask a question or share how you use OpenLLMetry.

Keep it helpful. Community rules

Loading discussion…

Comparisons & guides

Sources & review method

Documentation-based assessment · Oct 31, 2026 · Prepared with AI assistance; not a hands-on benchmark.

Checked by SOTA · AI-assisted documentation review. Selection advice is our assessment; verify current requirements for your deployment.

Editorial policy · Suggest a correction

Import history & original evidence

OpenLLMetry official website

Scope: Product overview · Imported Oct 31, 2026

Traceloop's open-source set of OpenTelemetry extensions that trace LLM calls, vector databases and agent frameworks and send the data to Traceloop or an existing observability backend.

Based on official pages and announcements checked on 2026-10-31. No hands-on test, performance benchmark or popularity ranking is claimed.