Llm Observability

OpikPython

An open-source platform for debugging, evaluating, and monitoring LLM applications, RAG systems, and agentic workflows with tracing and automated evaluations.

CometLLMPython

An open-source platform for debugging, evaluating, and monitoring LLM applications, RAG systems, and agentic workflows.

TensorZeroRust

An open-source LLMOps platform unifying gateway, observability, evaluation, optimization, and experimentation for industrial-grade LLM applications.

voltagentTypeScript

An end-to-end AI agent engineering platform with an open-source TypeScript framework and a production-ready observability console.

manifestTypeScript

A smart model router for OpenClaw that cuts LLM costs up to 70% by routing requests to the cheapest capable model.

agentaTypeScript

An open-source LLMOps platform for prompt management, evaluation, and observability to build reliable LLM applications faster.

OpenLITTypeScript

An open-source platform for AI engineering with OpenTelemetry-native LLM observability, GPU monitoring, guardrails, evaluations, and prompt management.

LitmusPython

Record and deterministically replay AI agent executions by intercepting LLM API calls, enabling offline trace capture and future fault injection.