Tools › Supports OpenTelemetry

Tools that support OpenTelemetry

OpenTelemetry is the open standard for traces, metrics and logs; its generative-AI conventions describe model and tool calls. These tools in the directory say they support it.

41 tools, in alphabetical order. Nothing is ranked by popularity, and no listing is paid for.

ToolMakerKind
Agenta
An LLMOps platform that combines a prompt playground, evaluation and observability for LLM applications.
Agentaopen source, hosted service
AgentScope
A Python framework for agents with message passing, tools, memory and a runtime for deploying them.
Alibaba Tongyi Labopen source
Amazon Bedrock AgentCore
AWS set of services for running agents: runtime, memory, tool gateway, identity, browser, code interpreter, observability and payments.
Amazon Web Servicesnot open source, hosted service
Arize AX
A hosted platform for observing, evaluating and improving AI agents and LLM applications in production.
Arize AInot open source, hosted service
Arize Phoenix
A tool for tracing, evaluating and debugging LLM applications, built on OpenTelemetry and OpenInference.
Arize AInot open source, hosted service
BeeAI Framework
A framework for building agents in Python and TypeScript, started at IBM Research and now under the Linux Foundation.
IBM Research and the Linux Foundationopen source
Bifrost
An AI gateway written in Go that provides one OpenAI-compatible API to many providers, and also acts as an MCP gateway.
Maxim AIopen source
Braintrust
A hosted platform for running evaluations, logging traces and managing prompts for AI applications.
Braintrustnot open source, hosted service
Burr
An Apache Python library for applications defined as state machines, with a local UI for tracing runs.
Apache Software Foundationopen source
Dapr Agents
A Python framework from the Dapr project for agents that run on Dapr's durable workflows and state stores.
Dapropen source
Datadog LLM Observability
A part of the Datadog monitoring service that traces, evaluates and monitors LLM applications and agents.
Datadognot open source, hosted service
Genkit
An open-source framework from Google for model applications and agents in JavaScript, Go, Python and Dart.
Googleopen source
Hatchet
A task queue and durable workflow engine on Postgres for background jobs and agent workloads.
Hatchetopen source, hosted service
Haystack
A Python framework from deepset for retrieval and agent pipelines assembled from components.
deepsetopen source, hosted service
HoneyHive
A platform for tracing, evaluating and monitoring AI agents, with datasets, alerts and prompt versioning.
HoneyHivenot open source, hosted service
Koog
A JetBrains framework for building agents in Kotlin and Java, with strategy graphs and Kotlin Multiplatform support.
JetBrainsopen source
Laminar
An open-source observability platform for AI agents with traces, evaluations and browser-agent session recordings.
Laminaropen source, hosted service
Langfuse
A platform for tracing, evaluating and managing prompts for LLM applications and agents, self-hosted or as a cloud service.
Langfuseopen source, hosted service
LangSmith
A hosted service from LangChain for tracing, evaluating and monitoring LLM applications and agents.
LangChainnot open source, hosted service
LangWatch
An open-source platform for tracing, evaluating and testing LLM applications and agents, with agent simulations.
LangWatchopen source, hosted service
Latitude
An open-source observability platform for AI agents that groups traces to find failures and test fixes.
Latitudeopen source, hosted service
LiteLLM
A Python SDK and proxy server that calls many model providers in the OpenAI format, with keys, budgets and routing.
BerriAIopen source, hosted service
Mastra
A TypeScript framework for agents, workflows, memory and evaluation, with a local development studio.
Mastraopen source, hosted service
Microsoft Agent Framework
Microsoft's open-source framework for agents and multi-agent workflows in .NET and Python.
Microsoftopen source
Microsoft Foundry Agent Service
Azure service for running agents, either as configured prompt agents or as hosted containers built with a framework of choice.
Microsoftnot open source, hosted service
MLflow
An open-source platform for machine learning and AI engineering that includes tracing, evaluation and a prompt registry for agents.
MLflow project (Linux Foundation)open source
NeMo Agent Toolkit
An NVIDIA library that wraps agents from other frameworks and adds configuration, profiling and evaluation.
NVIDIAopen source
OpenAI Agents SDK for Python
OpenAI's Python library for agents with tools, handoffs between agents, guardrails and tracing.
OpenAIopen source
OpenAI Agents SDK for TypeScript
OpenAI's TypeScript library for agents with tools, handoffs, guardrails, tracing and realtime voice.
OpenAIopen source
OpenInference
A set of conventions and instrumentation libraries that describe AI application traces on top of OpenTelemetry.
Arize AIopen source
OpenLIT
An OpenTelemetry-native tool for monitoring LLM applications, with traces, metrics, a prompt store and a secrets vault.
OpenLITopen source
OpenLLMetry
OpenTelemetry-based instrumentation libraries that trace calls to LLM providers, vector databases and frameworks.
Traceloopopen source, hosted service
OpenTelemetry GenAI semantic conventions
Standard attribute names for traces, metrics and events produced by generative AI and agent applications.
OpenTelemetryopen source
Opik
An open-source tool from Comet for tracing, evaluating and monitoring LLM applications, RAG systems and agents.
Cometopen source, hosted service
Plano
An AI-native proxy and data plane for agentic apps that handles model routing, orchestration and observability.
Katanemoopen source
Pydantic AI
A Python agent framework from the Pydantic team that uses typed inputs, outputs and dependencies.
Pydanticopen source
Pydantic Logfire
An observability service from the Pydantic team that traces applications and agents, built on OpenTelemetry.
Pydanticnot open source, hosted service
Strands Agents
An open-source SDK for building agents in Python and TypeScript, started by AWS.
Amazon Web Servicesopen source
Traceloop Hub
A gateway written in Rust that routes to many model providers with OpenTelemetry-based observability.
Traceloopopen source
TruLens
An open-source Python library for evaluating and tracking LLM applications and agents with feedback functions.
TruLens project (Snowflake)open source
W&B Weave
A toolkit from Weights & Biases for tracing, evaluating and monitoring LLM applications and agents.
Weights & Biasesopen source, hosted service