OpenLIT
An open-source platform for AI engineering with OpenTelemetry-native LLM observability, GPU monitoring, guardrails, evaluations, and prompt management.
What is OpenLIT?
OpenLIT is an open-source platform for AI engineering that provides comprehensive observability, monitoring, and management tools for LLM applications. It solves the problem of fragmented AI development workflows by integrating observability, evaluations, guardrails, and prompt management into a single platform. With OpenTelemetry-native instrumentation, it offers full-stack monitoring across LLM providers, vector databases, and GPUs.
AI engineers, ML developers, and DevOps teams building and deploying production LLM applications who need observability, evaluation, and management capabilities. It's particularly valuable for teams using multiple LLM providers and AI frameworks.
Developers choose OpenLIT because it provides a unified, open-source platform with vendor-neutral OpenTelemetry integration, eliminating lock-in to proprietary observability tools. Its comprehensive feature set—from observability to evaluations and prompt management—reduces the need for multiple disparate tools.
Overview
Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.
Use Cases
Best For
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
