# Tools that support OpenTelemetry

OpenTelemetry is the open standard for traces, metrics and logs; its generative-AI conventions describe model and tool calls. These tools in the directory say they support it.

41 tools, in alphabetical order. Nothing is ranked by popularity.

- [Agenta](https://modelmoot.com/tools/agenta.md): An LLMOps platform that combines a prompt playground, evaluation and observability for LLM applications. (Agenta; open source, hosted service)
- [AgentScope](https://modelmoot.com/tools/agentscope.md): A Python framework for agents with message passing, tools, memory and a runtime for deploying them. (Alibaba Tongyi Lab; open source)
- [Amazon Bedrock AgentCore](https://modelmoot.com/tools/bedrock-agentcore.md): AWS set of services for running agents: runtime, memory, tool gateway, identity, browser, code interpreter, observability and payments. (Amazon Web Services; not open source, hosted service)
- [Arize AX](https://modelmoot.com/tools/arize-ax.md): A hosted platform for observing, evaluating and improving AI agents and LLM applications in production. (Arize AI; not open source, hosted service)
- [Arize Phoenix](https://modelmoot.com/tools/arize-phoenix.md): A tool for tracing, evaluating and debugging LLM applications, built on OpenTelemetry and OpenInference. (Arize AI; not open source, hosted service)
- [BeeAI Framework](https://modelmoot.com/tools/beeai-framework.md): A framework for building agents in Python and TypeScript, started at IBM Research and now under the Linux Foundation. (IBM Research and the Linux Foundation; open source)
- [Bifrost](https://modelmoot.com/tools/bifrost.md): An AI gateway written in Go that provides one OpenAI-compatible API to many providers, and also acts as an MCP gateway. (Maxim AI; open source)
- [Braintrust](https://modelmoot.com/tools/braintrust.md): A hosted platform for running evaluations, logging traces and managing prompts for AI applications. (Braintrust; not open source, hosted service)
- [Burr](https://modelmoot.com/tools/burr.md): An Apache Python library for applications defined as state machines, with a local UI for tracing runs. (Apache Software Foundation; open source)
- [Dapr Agents](https://modelmoot.com/tools/dapr-agents.md): A Python framework from the Dapr project for agents that run on Dapr's durable workflows and state stores. (Dapr; open source)
- [Datadog LLM Observability](https://modelmoot.com/tools/datadog-llm-observability.md): A part of the Datadog monitoring service that traces, evaluates and monitors LLM applications and agents. (Datadog; not open source, hosted service)
- [Genkit](https://modelmoot.com/tools/genkit.md): An open-source framework from Google for model applications and agents in JavaScript, Go, Python and Dart. (Google; open source)
- [Hatchet](https://modelmoot.com/tools/hatchet.md): A task queue and durable workflow engine on Postgres for background jobs and agent workloads. (Hatchet; open source, hosted service)
- [Haystack](https://modelmoot.com/tools/haystack.md): A Python framework from deepset for retrieval and agent pipelines assembled from components. (deepset; open source, hosted service)
- [HoneyHive](https://modelmoot.com/tools/honeyhive.md): A platform for tracing, evaluating and monitoring AI agents, with datasets, alerts and prompt versioning. (HoneyHive; not open source, hosted service)
- [Koog](https://modelmoot.com/tools/koog.md): A JetBrains framework for building agents in Kotlin and Java, with strategy graphs and Kotlin Multiplatform support. (JetBrains; open source)
- [Laminar](https://modelmoot.com/tools/laminar.md): An open-source observability platform for AI agents with traces, evaluations and browser-agent session recordings. (Laminar; open source, hosted service)
- [Langfuse](https://modelmoot.com/tools/langfuse.md): A platform for tracing, evaluating and managing prompts for LLM applications and agents, self-hosted or as a cloud service. (Langfuse; open source, hosted service)
- [LangSmith](https://modelmoot.com/tools/langsmith.md): A hosted service from LangChain for tracing, evaluating and monitoring LLM applications and agents. (LangChain; not open source, hosted service)
- [LangWatch](https://modelmoot.com/tools/langwatch.md): An open-source platform for tracing, evaluating and testing LLM applications and agents, with agent simulations. (LangWatch; open source, hosted service)
- [Latitude](https://modelmoot.com/tools/latitude.md): An open-source observability platform for AI agents that groups traces to find failures and test fixes. (Latitude; open source, hosted service)
- [LiteLLM](https://modelmoot.com/tools/litellm.md): A Python SDK and proxy server that calls many model providers in the OpenAI format, with keys, budgets and routing. (BerriAI; open source, hosted service)
- [Mastra](https://modelmoot.com/tools/mastra.md): A TypeScript framework for agents, workflows, memory and evaluation, with a local development studio. (Mastra; open source, hosted service)
- [Microsoft Agent Framework](https://modelmoot.com/tools/microsoft-agent-framework.md): Microsoft's open-source framework for agents and multi-agent workflows in .NET and Python. (Microsoft; open source)
- [Microsoft Foundry Agent Service](https://modelmoot.com/tools/foundry-agent-service.md): Azure service for running agents, either as configured prompt agents or as hosted containers built with a framework of choice. (Microsoft; not open source, hosted service)
- [MLflow](https://modelmoot.com/tools/mlflow.md): An open-source platform for machine learning and AI engineering that includes tracing, evaluation and a prompt registry for agents. (MLflow project (Linux Foundation); open source)
- [NeMo Agent Toolkit](https://modelmoot.com/tools/nemo-agent-toolkit.md): An NVIDIA library that wraps agents from other frameworks and adds configuration, profiling and evaluation. (NVIDIA; open source)
- [OpenAI Agents SDK for Python](https://modelmoot.com/tools/openai-agents-python.md): OpenAI's Python library for agents with tools, handoffs between agents, guardrails and tracing. (OpenAI; open source)
- [OpenAI Agents SDK for TypeScript](https://modelmoot.com/tools/openai-agents-js.md): OpenAI's TypeScript library for agents with tools, handoffs, guardrails, tracing and realtime voice. (OpenAI; open source)
- [OpenInference](https://modelmoot.com/tools/openinference.md): A set of conventions and instrumentation libraries that describe AI application traces on top of OpenTelemetry. (Arize AI; open source)
- [OpenLIT](https://modelmoot.com/tools/openlit.md): An OpenTelemetry-native tool for monitoring LLM applications, with traces, metrics, a prompt store and a secrets vault. (OpenLIT; open source)
- [OpenLLMetry](https://modelmoot.com/tools/openllmetry.md): OpenTelemetry-based instrumentation libraries that trace calls to LLM providers, vector databases and frameworks. (Traceloop; open source, hosted service)
- [OpenTelemetry GenAI semantic conventions](https://modelmoot.com/tools/otel-genai.md): Standard attribute names for traces, metrics and events produced by generative AI and agent applications. (OpenTelemetry; open source)
- [Opik](https://modelmoot.com/tools/opik.md): An open-source tool from Comet for tracing, evaluating and monitoring LLM applications, RAG systems and agents. (Comet; open source, hosted service)
- [Plano](https://modelmoot.com/tools/plano.md): An AI-native proxy and data plane for agentic apps that handles model routing, orchestration and observability. (Katanemo; open source)
- [Pydantic AI](https://modelmoot.com/tools/pydantic-ai.md): A Python agent framework from the Pydantic team that uses typed inputs, outputs and dependencies. (Pydantic; open source)
- [Pydantic Logfire](https://modelmoot.com/tools/logfire.md): An observability service from the Pydantic team that traces applications and agents, built on OpenTelemetry. (Pydantic; not open source, hosted service)
- [Strands Agents](https://modelmoot.com/tools/strands-agents.md): An open-source SDK for building agents in Python and TypeScript, started by AWS. (Amazon Web Services; open source)
- [Traceloop Hub](https://modelmoot.com/tools/traceloop-hub.md): A gateway written in Rust that routes to many model providers with OpenTelemetry-based observability. (Traceloop; open source)
- [TruLens](https://modelmoot.com/tools/trulens.md): An open-source Python library for evaluating and tracking LLM applications and agents with feedback functions. (TruLens project (Snowflake); open source)
- [W&B Weave](https://modelmoot.com/tools/weave.md): A toolkit from Weights & Biases for tracing, evaluating and monitoring LLM applications and agents. (Weights & Biases; open source, hosted service)

HTML: https://modelmoot.com/tools/speaks/opentelemetry. All categories: https://modelmoot.com/tools.md
