Skip to content
appsgit

LLMKube

LLMKube is an open-source, self-hosted app in the AI & LLM Tools category, licensed Apache-2.0 and written mainly in Go. It ships a Docker image. It has 267 GitHub stars and its last commit was on Nov 15, 2026 (data as of Nov 16, 2026).

github.com/defilantech/LLMKube

GitHub stats

GitHub stars
267
Forks
47
Open issues
123
Commits, last 12 months
1,459
Last commit
Nov 15, 2026
Latest release
v0.10.18Nov 14, 2026
Created
Nov 12, 2025
License
Apache-2.0Open source

Data as of from the GitHub API. Report an error

Project health

ActiveActive: last commit Nov 15, 2026, 1,459 commits in 12 months.

Raw inputs behind the health label
Last commitNov 15, 2026
Commits, last 12 months1,459
Latest releasev0.10.18 (Nov 14, 2026)
Releases, last 12 months10 or more
Releases, all time320
Open issues123
Open pull requests23
Good first issues0
Contributing guideYes
Security policyYes
CreatedNov 12, 2025

Health as of , from the GitHub API. A label describes activity, not quality or security. How we label project health · Report a data error

About LLMKube

Kubernetes operator for LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.

Description adapted from awesome-selfhosted (CC BY-SA 3.0). Source code: github.com/defilantech/LLMKube.

Topics

  • ai
  • gguf
  • gpu
  • inference
  • kubernetes
  • kubernetes-operator
  • llama-cpp
  • llm
  • local-llm
  • nvidia

Repository preview

LLMKube repository previewdefilantech/LLMKubeOpen repository

FAQ

LLMKube FAQ

Still curious? Email info@appsgit.com.

Is LLMKube free and open source?

Yes. LLMKube is open-source software released under the Apache-2.0 license, so you can self-host it at no cost. You only pay for the server it runs on, and some projects also offer an optional paid cloud plan.

Can I run LLMKube with Docker?

Yes. LLMKube provides a Docker image, so you can run it on any Linux server with Docker and Docker Compose installed. The project README lists the image name and the environment variables to set.

What are the best alternatives to LLMKube?

Popular self-hosted alternatives to LLMKube include Ollama, Stable Diffusion WebUI and Open-WebUI.

Is LLMKube actively maintained?

The most recent commit to LLMKube was on Nov 15, 2026 with 1,459 commits in the past twelve months. The latest release is v0.10.18, published Nov 14, 2026. It had 123 open issues on GitHub. appsgit's project-health label for it is "Active" as of Nov 16, 2026.