# LLMKube

> LLMKube is a free, open-source app you can self-host in the AI & LLM tools category. Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and…. It has 231 GitHub stars, is released under the Apache-2.0 license and ships a Docker image.

## Key facts

| Fact | Value |
|---|---|
| Repository | https://github.com/defilantech/LLMKube |
| Website | https://llmkube.com/ |
| GitHub stars | 231 |
| Forks | 34 |
| Open issues | 101 |
| License | Apache-2.0 |
| License type | Open source |
| Language | Go |
| Docker image | Yes |
| Platforms | Go, Docker, K8S |
| Categories | AI & LLM Tools |
| Commits, last 12 months | 1,039 |
| Last commit | Oct 3, 2026 |
| Latest release | v0.10.1 (Sep 30, 2026) |
| Created | Nov 12, 2025 |
| Maintenance | Actively maintained |
| Archived | No |

Topics: ai, gguf, gpu, inference, kubernetes, kubernetes-operator, llama-cpp, llm, local-llm, nvidia

## Install

LLMKube ships a Docker image; follow the README at https://github.com/defilantech/LLMKube for the image name and environment variables.

Need it installed for you? [appsgit installation help](https://appsgit.com/services/install): a fixed quote by email, single app installs from $79.

## Similar apps in AI & LLM Tools

- [Ollama](https://appsgit.com/apps/ollama): Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models. (182,289 stars, MIT, Go, Docker)
- [Stable Diffusion WebUI](https://appsgit.com/apps/stable-diffusion-webui): Browser interface for Stable Diffusion image generation. (165,199 stars, AGPL-3.0, Python)
- [Langflow](https://appsgit.com/apps/langflow): Visual framework for building and deploying AI agents and RAG workflows. (155,530 stars, MIT, Python, Docker)
- [Open-WebUI](https://appsgit.com/apps/open-webui): User-friendly AI Interface, supports Ollama, OpenAI API. (154,037 stars, Open WebUI License, source-available, Python, Docker)
- [ComfyUI](https://appsgit.com/apps/comfyui): Node-based interface and engine for diffusion image and video generation. (136,240 stars, GPL-3.0, Python)
- [RAGFlow](https://appsgit.com/apps/ragflow): Open-source RAG engine with deep document understanding. (91,708 stars, Apache-2.0, Go, Docker)
- [OpenHands](https://appsgit.com/apps/openhands): Platform for AI software development agents that write code and run commands. (90,074 stars, MIT, TypeScript, Docker)
- [LobeHub](https://appsgit.com/apps/lobehub): Modern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking. (83,008 stars, LobeHub Community License, source-available, TypeScript, Docker)

---

Canonical page: https://appsgit.com/apps/llmkube
Source: appsgit (https://appsgit.com), the app store for github. Data from the GitHub API, refreshed nightly.
Machine access: JSON API https://appsgit.com/api/v1/apps (OpenAPI: https://appsgit.com/openapi.json), MCP server https://mcp.appsgit.com/mcp, full index https://appsgit.com/llms-full.txt.