LLM Harbor
Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI.
- AI & LLM Tools
- Python
- Apache-2.0
- Docker
- Actively maintained
GitHub stats
- GitHub stars
- 3,237
- Forks
- 228
- Open issues
- 39
- Commits, last 12 months
- 1,288
- Last commit
- Sep 25, 2026
- Latest release
- v0.5.14Sep 25, 2026
- Created
- Jul 27, 2024
Data from the GitHub API, refreshed daily.
About LLM Harbor
Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI. LLM Harbor is open source under the Apache-2.0 license and written mainly in Python, so you can read the code, run it on your own hardware and keep full control of your data.
The project has 3,237 stars and 228 forks on GitHub, with 1,288 commits over the last year. It ships a Docker image, which makes it a good fit for a small VPS or a home server running Docker Compose.
Topics
- cli
- docker
- docker-compose
- llm
- tools
- ai
- self-hosted
- tool
- bash
- container
Repository preview
Similar apps
More apps like LLM Harbor
Other projects in AI & LLM Tools, ranked by GitHub stars.
Ollama
ollama/ollama
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
AI & LLM ToolsGoDockerStable Diffusion WebUI
AUTOMATIC1111/stable-diffusion-webui
Browser interface for Stable Diffusion image generation.
AI & LLM ToolsPythonLangflow
langflow-ai/langflow
Visual framework for building and deploying AI agents and RAG workflows.
AI & LLM ToolsPythonDockerOpen-WebUI
open-webui/open-webui
User-friendly AI Interface, supports Ollama, OpenAI API.
AI & LLM ToolsPythonDockerComfyUI
Comfy-Org/ComfyUI
Node-based interface and engine for diffusion image and video generation.
AI & LLM ToolsPythonRAGFlow
infiniflow/ragflow
Open-source RAG engine with deep document understanding.
AI & LLM ToolsGoDocker
What is LLM Harbor?
LLM Harbor is a free, open-source app you can host on your own server, listed in our AI & LLM Tools category. Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI. The source code lives at github.com/av/harbor, where it has 3,237 stars.
Is LLM Harbor free and open source?
Yes. LLM Harbor is open-source software released under the Apache-2.0 license, so you can self-host it at no cost. You only pay for the server it runs on, and some projects also offer an optional paid cloud plan.
Can I run LLM Harbor with Docker?
Yes. LLM Harbor provides a Docker image, so you can run it on any Linux server with Docker and Docker Compose installed. The project README lists the image name and the environment variables to set.
What are the best alternatives to LLM Harbor?
Popular open-source alternatives to LLM Harbor include Ollama, Stable Diffusion WebUI and Langflow.
Is LLM Harbor actively maintained?
The most recent commit to LLM Harbor was on Sep 25, 2026 with 1,288 commits in the past twelve months. The latest release is v0.5.14, published Sep 25, 2026. Check the open issues on GitHub to gauge how quickly maintainers respond.