Tools › Supports OpenTelemetry
Tools that support OpenTelemetry
OpenTelemetry is the open standard for traces, metrics and logs; its generative-AI conventions describe model and tool calls. These tools in the directory say they support it.
41 tools, in alphabetical order. Nothing is ranked by popularity, and no listing is paid for.
| Tool | Maker | Kind |
|---|---|---|
| Agenta An LLMOps platform that combines a prompt playground, evaluation and observability for LLM applications. | Agenta | open source, hosted service |
| AgentScope A Python framework for agents with message passing, tools, memory and a runtime for deploying them. | Alibaba Tongyi Lab | open source |
| Amazon Bedrock AgentCore AWS set of services for running agents: runtime, memory, tool gateway, identity, browser, code interpreter, observability and payments. | Amazon Web Services | not open source, hosted service |
| Arize AX A hosted platform for observing, evaluating and improving AI agents and LLM applications in production. | Arize AI | not open source, hosted service |
| Arize Phoenix A tool for tracing, evaluating and debugging LLM applications, built on OpenTelemetry and OpenInference. | Arize AI | not open source, hosted service |
| BeeAI Framework A framework for building agents in Python and TypeScript, started at IBM Research and now under the Linux Foundation. | IBM Research and the Linux Foundation | open source |
| Bifrost An AI gateway written in Go that provides one OpenAI-compatible API to many providers, and also acts as an MCP gateway. | Maxim AI | open source |
| Braintrust A hosted platform for running evaluations, logging traces and managing prompts for AI applications. | Braintrust | not open source, hosted service |
| Burr An Apache Python library for applications defined as state machines, with a local UI for tracing runs. | Apache Software Foundation | open source |
| Dapr Agents A Python framework from the Dapr project for agents that run on Dapr's durable workflows and state stores. | Dapr | open source |
| Datadog LLM Observability A part of the Datadog monitoring service that traces, evaluates and monitors LLM applications and agents. | Datadog | not open source, hosted service |
| Genkit An open-source framework from Google for model applications and agents in JavaScript, Go, Python and Dart. | open source | |
| Hatchet A task queue and durable workflow engine on Postgres for background jobs and agent workloads. | Hatchet | open source, hosted service |
| Haystack A Python framework from deepset for retrieval and agent pipelines assembled from components. | deepset | open source, hosted service |
| HoneyHive A platform for tracing, evaluating and monitoring AI agents, with datasets, alerts and prompt versioning. | HoneyHive | not open source, hosted service |
| Koog A JetBrains framework for building agents in Kotlin and Java, with strategy graphs and Kotlin Multiplatform support. | JetBrains | open source |
| Laminar An open-source observability platform for AI agents with traces, evaluations and browser-agent session recordings. | Laminar | open source, hosted service |
| Langfuse A platform for tracing, evaluating and managing prompts for LLM applications and agents, self-hosted or as a cloud service. | Langfuse | open source, hosted service |
| LangSmith A hosted service from LangChain for tracing, evaluating and monitoring LLM applications and agents. | LangChain | not open source, hosted service |
| LangWatch An open-source platform for tracing, evaluating and testing LLM applications and agents, with agent simulations. | LangWatch | open source, hosted service |
| Latitude An open-source observability platform for AI agents that groups traces to find failures and test fixes. | Latitude | open source, hosted service |
| LiteLLM A Python SDK and proxy server that calls many model providers in the OpenAI format, with keys, budgets and routing. | BerriAI | open source, hosted service |
| Mastra A TypeScript framework for agents, workflows, memory and evaluation, with a local development studio. | Mastra | open source, hosted service |
| Microsoft Agent Framework Microsoft's open-source framework for agents and multi-agent workflows in .NET and Python. | Microsoft | open source |
| Microsoft Foundry Agent Service Azure service for running agents, either as configured prompt agents or as hosted containers built with a framework of choice. | Microsoft | not open source, hosted service |
| MLflow An open-source platform for machine learning and AI engineering that includes tracing, evaluation and a prompt registry for agents. | MLflow project (Linux Foundation) | open source |
| NeMo Agent Toolkit An NVIDIA library that wraps agents from other frameworks and adds configuration, profiling and evaluation. | NVIDIA | open source |
| OpenAI Agents SDK for Python OpenAI's Python library for agents with tools, handoffs between agents, guardrails and tracing. | OpenAI | open source |
| OpenAI Agents SDK for TypeScript OpenAI's TypeScript library for agents with tools, handoffs, guardrails, tracing and realtime voice. | OpenAI | open source |
| OpenInference A set of conventions and instrumentation libraries that describe AI application traces on top of OpenTelemetry. | Arize AI | open source |
| OpenLIT An OpenTelemetry-native tool for monitoring LLM applications, with traces, metrics, a prompt store and a secrets vault. | OpenLIT | open source |
| OpenLLMetry OpenTelemetry-based instrumentation libraries that trace calls to LLM providers, vector databases and frameworks. | Traceloop | open source, hosted service |
| OpenTelemetry GenAI semantic conventions Standard attribute names for traces, metrics and events produced by generative AI and agent applications. | OpenTelemetry | open source |
| Opik An open-source tool from Comet for tracing, evaluating and monitoring LLM applications, RAG systems and agents. | Comet | open source, hosted service |
| Plano An AI-native proxy and data plane for agentic apps that handles model routing, orchestration and observability. | Katanemo | open source |
| Pydantic AI A Python agent framework from the Pydantic team that uses typed inputs, outputs and dependencies. | Pydantic | open source |
| Pydantic Logfire An observability service from the Pydantic team that traces applications and agents, built on OpenTelemetry. | Pydantic | not open source, hosted service |
| Strands Agents An open-source SDK for building agents in Python and TypeScript, started by AWS. | Amazon Web Services | open source |
| Traceloop Hub A gateway written in Rust that routes to many model providers with OpenTelemetry-based observability. | Traceloop | open source |
| TruLens An open-source Python library for evaluating and tracking LLM applications and agents with feedback functions. | TruLens project (Snowflake) | open source |
| W&B Weave A toolkit from Weights & Biases for tracing, evaluating and monitoring LLM applications and agents. | Weights & Biases | open source, hosted service |