langfuse/langfuse
Langfuse is an open-source LLM engineering platform for developing, monitoring, evaluating, and debugging AI applications, offering observability, prompt management, and evaluation capabilities.
Awesome Infra for AI › LLM Observability & Tracing
LockedinLabs-AI/agent-console
Agent Console is an open-source, local-first observability tool for AI coding agents, built by LockedIn Labs. It reads the transcripts that Claude Code and Codex sessions already write on disk and turns them into a unified view of token consumption, cache reads and writes, model selection, and estimated cost at list price, without requiring any telemetry, update checks, or crash reporting to leave the machine. Multiple machines, such as laptops and build servers, can join a self-hosted team hub so that a team's usage across devices appears in one console, with each machine's activity kept in its own lane so nothing is double-counted. The tool can optionally ingest Claude Code's OpenTelemetry output as well as token metrics from gateway or proxy layers such as Kong or LiteLLM, and it exposes a Prometheus-compatible /metrics endpoint plus a ready-made Grafana dashboard for teams that already run a metrics stack. A bundled demo mode generates entirely synthetic data so the interface can be evaluated without connecting real sessions. The project requires Node.js 22 or newer and ships as open-source software with documentation covering architecture, security and data-flow details, and a changelog. It is aimed at individual developers and teams who want to understand and control the cost and resource footprint of AI coding agents running locally or across a fleet of machines, an operational concern that grows as more engineering work shifts to agent-driven coding sessions.
https://github.com/LockedinLabs-AI/agent-console
Also in LLM Observability & Tracing
comet-ml/opik
Opik is an open-source platform for comprehensive observability, evaluation, and optimization of LLM applications, RAG systems, and agentic workflows.
raga-ai-hub/RagaAI-Catalyst
RagaAI Catalyst is a Python SDK for comprehensive observability, monitoring, and evaluation of AI agents and LLM applications, offering tracing, debugging, and advanced analytics.
Arize-ai/phoenix
Phoenix is an open-source AI observability platform for LLM application experimentation, evaluation, and troubleshooting, providing tracing, evaluation, dataset management, prompt management, and a...
VoltAgent/voltagent
VoltAgent is an end-to-end AI Agent Engineering Platform offering an open-source TypeScript framework for building intelligent agents and a VoltOps Console for observability, automation, deployment...
traceloop/openllmetry
OpenLLMetry provides open-source observability for LLM applications by extending OpenTelemetry to capture traces and metrics from LLM providers, vector databases, and AI frameworks.
Helicone/helicone
Helicone is an open-source LLM observability platform and AI gateway that provides monitoring, evaluation, prompt management, and intelligent routing for large language models.
Agenta-AI/agenta
Agenta is an open-source LLMOps platform designed to accelerate the development of reliable LLM applications, offering integrated prompt management, evaluation, and observability features.