Open-Awesome
CategoriesAlternativesStacksSelf-HostedExplore
Open-Awesome

© 2026 Open-Awesome. Curated for the developer elite.

TermsPrivacyAboutGitHubRSS
  1. Home
  2. Tags
  3. Llmops

Llmops

16 projects

Showing 16 of 16 projects

LLM App
LLM AppJupyter Notebook

Ready-to-deploy Docker templates for building real-time RAG, AI pipelines, and enterprise search applications with live data sync.

#ai-pipelines#data-synchronization#llm-prompting
Stars59.4k
Forks1.4k
Last commit5 days ago
promptfoo
promptfooTypeScript

A CLI and library for evaluating, red-teaming, and comparing LLM prompts, agents, and RAGs with simple declarative configs.

#agent-testing#ai-testing#llmops
Stars22.0k
Forks1.9k
Last commit19 hours ago
Opik
OpikPython

An open-source platform for debugging, evaluating, and monitoring LLM applications, RAG systems, and agentic workflows with tracing and automated evaluations.

#tracing#open-source#ai-evaluation
Stars19.4k
Forks1.5k
Last commit18 hours ago
CometLLM
CometLLMPython

An open-source platform for debugging, evaluating, and monitoring LLM applications, RAG systems, and agentic workflows.

#python-sdk#ai-observability#open-source
Stars19.4k
Forks1.5k
Last commit18 hours ago
TensorZero
TensorZeroRust

An open-source LLMOps platform unifying gateway, observability, evaluation, optimization, and experimentation for industrial-grade LLM applications.

#ai-gateway#ai#deep-learning
Stars11.4k
Forks836
Last commit2 days ago
BentoML
BentoMLPython

A Python library for building production-ready model inference APIs, job queues, and multi-model serving systems for AI applications.

#llm-serving#python-library#deep-learning
Stars8.7k
Forks970
Last commit5 days ago
rig
rigRust

A Rust library for building scalable, modular, and ergonomic LLM-powered applications.

#ai#embedding#agentic-workflows
Stars7.6k
Forks841
Last commit2 days ago
ClearML
ClearMLPython

An open-source MLOps/LLMOps suite for experiment management, data management, pipelines, orchestration, scheduling, and model serving.

#experiment-manager#ai#version-control
Stars6.7k
Forks782
Last commit7 days ago
plano
planoRust

An AI-native proxy and data plane for agentic applications, providing built-in orchestration, safety, observability, and smart LLM routing.

#proxy#observability#gateway
Stars6.6k
Forks429
Last commit4 days ago
zenml
zenmlPython

An open-source MLOps platform for building, orchestrating, and deploying production AI pipelines and agents.

#pipelines#ai-pipelines#data-science
Stars5.4k
Forks624
Last commit1 day ago
LLM Engineer Handbook
LLM Engineer Handbook

A curated collection of resources for building, training, serving, and optimizing production-grade Large Language Model applications.

#llmops#fine-tuning#prompt-engineering
Stars5.0k
Forks703
Last commit9 months ago
Seldon Core
Seldon CoreGo

An MLOps framework to package, deploy, monitor, and manage thousands of production machine learning models on Kubernetes.

#deployment#aiops#ai-pipelines
Stars4.8k
Forks865
Last commit2 months ago
agenta
agentaTypeScript

An open-source LLMOps platform for prompt management, evaluation, and observability to build reliable LLM applications faster.

#production-ml#llmops#prompt-engineering
Stars4.2k
Forks540
Last commit1 day ago
Hands-on LLMs: Train and Deploy a Real-time Financial Advisor
Hands-on LLMs: Train and Deploy a Real-time Financial AdvisorJupyter Notebook

A free course teaching how to design, train, and deploy a production-ready real-time financial advisor LLM system using RAG and LLMOps.

#financial-ai#llmops#fine-tuning
Stars3.4k
Forks552
Last commit
OpenLIT
OpenLITTypeScript

An open-source platform for AI engineering with OpenTelemetry-native LLM observability, GPU monitoring, guardrails, evaluations, and prompt management.

#ai-observability#ai-evaluation#observability
Stars2.5k
Forks291
Last commit3 days ago
envd
envdGo

A command-line tool for creating reproducible, container-based development environments for AI/ML workflows.

#cuda#hacktoberfest#developer-tools
Stars2.2k
Forks168
Last commit17 days ago

Related Tags

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a projectStar on GitHub
1 year ago
#Machine Learning10
#Llm6
#Opentelemetry6
#Prompt Engineering6
#Mlops6
#Llm Observability5
#Llm Evaluation5
#Openai5
#Model Serving5
#Generative Ai4
#Deep Learning4
#Langchain4