LLM Harbor
A CLI and companion app that spins up a complete, pre-wired local LLM stack with hundreds of services using a single command.
What is LLM Harbor?
Harbor is a CLI and companion application that lets you spin up a complete local LLM stack—including backends like Ollama and llama.cpp, frontends like Open WebUI, and supporting services for search, voice chat, and image generation—with a single `harbor up` command. It handles Docker Compose orchestration, configuration, and cross-service connectivity, enabling users to focus on using models rather than manual setup.
Developers and researchers experimenting with local LLMs who want a pre-configured, integrated stack without manually managing Docker containers and service connections. It's also suitable for those who need to quickly prototype or test different LLM frontends, backends, and satellite services together.
Developers choose Harbor for its one-command setup of a fully integrated local LLM ecosystem with pre-wired connectivity between services, eliminating complex manual configuration. Its extensive catalog of hundreds of services and ability to export setups to standalone Docker Compose files provide both convenience and flexibility.
Overview
One command brings a complete pre-wired LLM stack with hundreds of services to explore.
Use Cases
Best For
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
