LLMKube
LLMKube is an open-source, self-hosted app in the AI & LLM Tools category, licensed Apache-2.0 and written mainly in Go. It ships a Docker image. It has 267 GitHub stars and its last commit was on Nov 15, 2026 (data as of Nov 16, 2026).
GitHub stats
- GitHub stars
- 267
- Forks
- 47
- Open issues
- 123
- Commits, last 12 months
- 1,459
- Last commit
- Nov 15, 2026
- Latest release
- v0.10.18Nov 14, 2026
- Created
- Nov 12, 2025
- License
- Apache-2.0Open source
Data as of from the GitHub API. Report an error
Project health
ActiveActive: last commit Nov 15, 2026, 1,459 commits in 12 months.
- Regular releases10 or more releases in 12 months
- Security policyPublishes a security policy on GitHub
| Last commit | Nov 15, 2026 |
|---|---|
| Commits, last 12 months | 1,459 |
| Latest release | v0.10.18 (Nov 14, 2026) |
| Releases, last 12 months | 10 or more |
| Releases, all time | 320 |
| Open issues | 123 |
| Open pull requests | 23 |
| Good first issues | 0 |
| Contributing guide | Yes |
| Security policy | Yes |
| Created | Nov 12, 2025 |
Health as of , from the GitHub API. A label describes activity, not quality or security. How we label project health · Report a data error
About LLMKube
Kubernetes operator for LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.
Description adapted from awesome-selfhosted (CC BY-SA 3.0). Source code: github.com/defilantech/LLMKube.
Topics
- ai
- gguf
- gpu
- inference
- kubernetes
- kubernetes-operator
- llama-cpp
- llm
- local-llm
- nvidia
Repository preview
Similar apps
More apps like LLMKube
Other projects in AI & LLM Tools, ranked by GitHub stars.
Ollama
ollama/ollama
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
Active · last commit Nov 16, 2026
AI & LLM ToolsGoDockerStable Diffusion WebUI
AUTOMATIC1111/stable-diffusion-webui
Browser interface for Stable Diffusion image generation.
Maintained · last commit Mar 2, 2026
AI & LLM ToolsPythonOpen-WebUI
open-webui/open-webui
User-friendly AI Interface, supports Ollama, OpenAI API.
Active · last commit Nov 16, 2026
Source-availableAI & LLM ToolsSvelteDockerLangflow
langflow-ai/langflow
Visual framework for building and deploying AI agents and RAG workflows.
Active · last commit Nov 16, 2026
AI & LLM ToolsPythonDockerComfyUI
Comfy-Org/ComfyUI
Node-based interface and engine for diffusion image and video generation.
Active · last commit Nov 16, 2026
AI & LLM ToolsPythonRAGFlow
infiniflow/ragflow
Open-source RAG engine with deep document understanding.
Active · last commit Nov 16, 2026
AI & LLM ToolsGoDocker
Is LLMKube free and open source?
Yes. LLMKube is open-source software released under the Apache-2.0 license, so you can self-host it at no cost. You only pay for the server it runs on, and some projects also offer an optional paid cloud plan.
Can I run LLMKube with Docker?
Yes. LLMKube provides a Docker image, so you can run it on any Linux server with Docker and Docker Compose installed. The project README lists the image name and the environment variables to set.
What are the best alternatives to LLMKube?
Popular self-hosted alternatives to LLMKube include Ollama, Stable Diffusion WebUI and Open-WebUI.
Is LLMKube actively maintained?
The most recent commit to LLMKube was on Nov 15, 2026 with 1,459 commits in the past twelve months. The latest release is v0.10.18, published Nov 14, 2026. It had 123 open issues on GitHub. appsgit's project-health label for it is "Active" as of Nov 16, 2026.