langfuse/langfuse
Langfuse is an open-source LLM engineering platform for developing, monitoring, evaluating, and debugging AI applications, offering observability, prompt management, and evaluation capabilities.
Awesome Infra for AI › LLM Observability & Tracing
liaohch3/claude-tap
claude-tap is a local proxy and trace viewer designed for AI coding agents. It intercepts and inspects API traffic from various coding CLI tools such as Claude Code, Codex CLI, Gemini CLI, Kimi CLI, OpenCode, and others. The tool allows developers to observe the exact context of agent interactions, including system prompts, conversation history, tool schemas, tool calls, streaming responses, and token usage. It provides a trace viewer to analyze the real API traffic, helping debug agent behavior by comparing adjacent requests and identifying changes in prompts, messages, or parameters. The project emphasizes privacy by keeping traces local and redacting authentication headers. Each run generates a portable, self-contained HTML trace session that can be easily shared or archived. It runs as a Python application and acts as an intermediary, forwarding traffic to the actual AI service after inspection. claude-tap's core purpose is to provide deep operational visibility into how AI agents are interacting with underlying LLMs and tools, making it invaluable for testing, debugging, and understanding agent-driven applications.
https://github.com/liaohch3/claude-tap
Also in LLM Observability & Tracing
comet-ml/opik
Opik is an open-source platform for comprehensive observability, evaluation, and optimization of LLM applications, RAG systems, and agentic workflows.
raga-ai-hub/RagaAI-Catalyst
RagaAI Catalyst is a Python SDK for comprehensive observability, monitoring, and evaluation of AI agents and LLM applications, offering tracing, debugging, and advanced analytics.
Arize-ai/phoenix
Phoenix is an open-source AI observability platform for LLM application experimentation, evaluation, and troubleshooting, providing tracing, evaluation, dataset management, prompt management, and a...
VoltAgent/voltagent
VoltAgent is an end-to-end AI Agent Engineering Platform offering an open-source TypeScript framework for building intelligent agents and a VoltOps Console for observability, automation, deployment...
traceloop/openllmetry
OpenLLMetry provides open-source observability for LLM applications by extending OpenTelemetry to capture traces and metrics from LLM providers, vector databases, and AI frameworks.
Helicone/helicone
Helicone is an open-source LLM observability platform and AI gateway that provides monitoring, evaluation, prompt management, and intelligent routing for large language models.
Agenta-AI/agenta
Agenta is an open-source LLMOps platform designed to accelerate the development of reliable LLM applications, offering integrated prompt management, evaluation, and observability features.