Open-Awesome
CategoriesAlternativesStacksSelf-HostedExplore
Open-Awesome

© 2026 Open-Awesome. Curated for the developer elite.

TermsPrivacyAboutGitHubRSS
  1. Home
  2. Tags
  3. Llmops

Llmops

16 projects

Showing 16 of 16 projects

LLM App
LLM AppJupyter Notebook

Ready-to-deploy Docker templates for building real-time RAG, AI pipelines, and enterprise search applications with live data sync.

#ai-pipelines#data-synchronization#llm-prompting
Stars59.9k
Forks1.4k
Last commit3 months ago
promptfoo
promptfooTypeScript

A CLI and library for evaluating, red-teaming, and comparing LLM prompts, agents, and RAGs with simple declarative configs.

#agent-testing#ai-testing#llmops
Stars20.5k
Forks1.8k
Last commit1 day ago
Opik
OpikPython

An open-source platform for debugging, evaluating, and monitoring LLM applications, RAG systems, and agentic workflows with tracing and automated evaluations.

#tracing#open-source#ai-evaluation
Stars19.0k
Forks1.4k
Last commit1 day ago
CometLLM
CometLLMPython

An open-source platform for debugging, evaluating, and monitoring LLM applications, RAG systems, and agentic workflows.

#python-sdk#ai-observability#open-source
Stars19.0k
Forks1.4k
Last commit1 day ago
TensorZero
TensorZeroRust

An open-source LLMOps platform unifying gateway, observability, evaluation, optimization, and experimentation for industrial-grade LLM applications.

#ai-gateway#ai#deep-learning
Stars11.3k
Forks820
Last commit1 day ago
BentoML
BentoMLPython

A Python library for building production-ready model inference APIs, job queues, and multi-model serving systems for AI applications.

#llm-serving#python-library#deep-learning
Stars8.6k
Forks950
Last commit8 days ago
rig
rigRust

A Rust library for building scalable, modular, and ergonomic LLM-powered applications.

#ai#embedding#agentic-workflows
Stars7.0k
Forks776
Last commit1 day ago
ClearML
ClearMLPython

An open-source MLOps/LLMOps suite for experiment management, data management, pipelines, orchestration, scheduling, and model serving.

#experiment-manager#ai#version-control
Stars6.6k
Forks771
Last commit3 days ago
plano
planoRust

An AI-native proxy and data plane for agentic applications, providing built-in orchestration, safety, observability, and smart LLM routing.

#proxy#observability#gateway
Stars6.4k
Forks404
Last commit1 day ago
zenml
zenmlPython

An open-source MLOps platform for building, orchestrating, and deploying production AI pipelines and agents.

#pipelines#ai-pipelines#data-science
Stars5.4k
Forks607
Last commit1 day ago
LLM Engineer Handbook
LLM Engineer Handbook

A curated collection of resources for building, training, serving, and optimizing production-grade Large Language Model applications.

#llmops#fine-tuning#prompt-engineering
Stars4.9k
Forks689
Last commit8 months ago
Seldon Core
Seldon CoreGo

An MLOps framework to package, deploy, monitor, and manage thousands of production machine learning models on Kubernetes.

#deployment#aiops#ai-pipelines
Stars4.7k
Forks862
Last commit1 month ago
agenta
agentaTypeScript

An open-source LLMOps platform for prompt management, evaluation, and observability to build reliable LLM applications faster.

#production-ml#llmops#prompt-engineering
Stars4.0k
Forks511
Last commit1 day ago
Hands-on LLMs: Train and Deploy a Real-time Financial Advisor
Hands-on LLMs: Train and Deploy a Real-time Financial AdvisorJupyter Notebook

A free course teaching how to design, train, and deploy a production-ready real-time financial advisor LLM system using RAG and LLMOps.

#financial-ai#llmops#fine-tuning
Stars3.4k
Forks550
Last commit1 year ago
OpenLIT
OpenLITTypeScript

An open-source platform for AI engineering with OpenTelemetry-native LLM observability, GPU monitoring, guardrails, evaluations, and prompt management.

#ai-observability#ai-evaluation#observability
Stars2.4k
Forks266
Last commit4 days ago
envd
envdGo

A command-line tool for creating reproducible, container-based development environments for AI/ML workflows.

#cuda#hacktoberfest#developer-tools
Stars2.2k
Forks167
Last commit14 days ago

Related Tags

#Machine Learning10#Llm6#Mlops6#Opentelemetry6#Prompt Engineering6#Llm Evaluation5#Openai5#Llm Observability5#Model Serving5#Langchain4#Llms4#Kubernetes4
Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a projectStar on GitHub