LLMKube
LLMKube is an open-source, self-hosted app in the AI & LLM Tools category, licensed Apache-2.0 and written mainly in Go. It ships a Docker image. It has 245 GitHub stars and its last commit was on Oct 25, 2026 (data as of Oct 26, 2026).
GitHub stats
- GitHub stars
- 245
- Forks
- 41
- Open issues
- 124
- Commits, last 12 months
- 1,292
- Last commit
- Oct 25, 2026
- Latest release
- v0.10.11Oct 25, 2026
- Created
- Nov 12, 2025
- License
- Apache-2.0Open source
Data as of from the GitHub API. Report an error
Project health
ActiveActive: last commit Oct 25, 2026, 1,292 commits in 12 months.
- Regular releases10 or more releases in 12 months
- Security policyPublishes a security policy on GitHub
| Last commit | Oct 25, 2026 |
|---|---|
| Commits, last 12 months | 1,292 |
| Latest release | v0.10.11 (Oct 25, 2026) |
| Releases, last 12 months | 10 or more |
| Releases, all time | 299 |
| Open issues | 124 |
| Open pull requests | 9 |
| Good first issues | 0 |
| Contributing guide | Yes |
| Security policy | Yes |
| Created | Nov 12, 2025 |
Health as of , from the GitHub API. A label describes activity, not quality or security. How we label project health · Report a data error
About LLMKube
Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and….
Description adapted from awesome-selfhosted (CC BY-SA 3.0). Source code: github.com/defilantech/LLMKube.
Topics
- ai
- gguf
- gpu
- inference
- kubernetes
- kubernetes-operator
- llama-cpp
- llm
- local-llm
- nvidia
Repository preview
Similar apps
More apps like LLMKube
Other projects in AI & LLM Tools, ranked by GitHub stars.
Ollama
ollama/ollama
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
Active · last commit Oct 26, 2026
AI & LLM ToolsGoDockerStable Diffusion WebUI
AUTOMATIC1111/stable-diffusion-webui
Browser interface for Stable Diffusion image generation.
Maintained · last commit Mar 2, 2026
AI & LLM ToolsPythonOpen-WebUI
open-webui/open-webui
User-friendly AI Interface, supports Ollama, OpenAI API.
Active · last commit Oct 26, 2026
Source-availableAI & LLM ToolsPythonDockerLangflow
langflow-ai/langflow
Visual framework for building and deploying AI agents and RAG workflows.
Active · last commit Oct 26, 2026
AI & LLM ToolsPythonDockerComfyUI
Comfy-Org/ComfyUI
Node-based interface and engine for diffusion image and video generation.
Active · last commit Oct 26, 2026
AI & LLM ToolsPythonRAGFlow
infiniflow/ragflow
Open-source RAG engine with deep document understanding.
Active · last commit Oct 26, 2026
AI & LLM ToolsGoDocker
Is LLMKube free and open source?
Yes. LLMKube is open-source software released under the Apache-2.0 license, so you can self-host it at no cost. You only pay for the server it runs on, and some projects also offer an optional paid cloud plan.
Can I run LLMKube with Docker?
Yes. LLMKube provides a Docker image, so you can run it on any Linux server with Docker and Docker Compose installed. The project README lists the image name and the environment variables to set.
What are the best alternatives to LLMKube?
Popular self-hosted alternatives to LLMKube include Ollama, Stable Diffusion WebUI and Open-WebUI.
Is LLMKube actively maintained?
The most recent commit to LLMKube was on Oct 25, 2026 with 1,292 commits in the past twelve months. The latest release is v0.10.11, published Oct 25, 2026. It had 124 open issues on GitHub. appsgit's project-health label for it is "Active" as of Oct 26, 2026.