24 open-source apps
Best self-hosted AI & LLM Tools apps
Self-hosted chat interfaces, model runners and AI platforms. Run large language models locally or on your own servers for private ChatGPT alternatives.
The most popular self-hosted apps for AI & LLM tools on GitHub are Ollama, Stable Diffusion WebUI and Langflow, ranked by stars below.
Ranked by GitHub stars
All 24 AI & LLM Tools apps
Ollama
ollama/ollama
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
AI & LLM ToolsGoDockerStable Diffusion WebUI
AUTOMATIC1111/stable-diffusion-webui
Browser interface for Stable Diffusion image generation.
AI & LLM ToolsPythonLangflow
langflow-ai/langflow
Visual framework for building and deploying AI agents and RAG workflows.
AI & LLM ToolsPythonDockerOpen-WebUI
open-webui/open-webui
User-friendly AI Interface, supports Ollama, OpenAI API.
AI & LLM ToolsPythonDockerComfyUI
Comfy-Org/ComfyUI
Node-based interface and engine for diffusion image and video generation.
AI & LLM ToolsPythonRAGFlow
infiniflow/ragflow
Open-source RAG engine with deep document understanding.
AI & LLM ToolsGoDockerOpenHands
OpenHands/OpenHands
Platform for AI software development agents that write code and run commands.
AI & LLM ToolsTypeScriptDockerLobeHub
lobehub/lobehub
Modern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking.
AI & LLM ToolsTypeScriptDockerAnythingLLM
Mintplex-Labs/anything-llm
All-in-one desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.
AI & LLM ToolsJavaScriptDockerLocalAI
mudler/LocalAI
Run your AI models locally and generate images and audio (alternative to OpenAI and Claude).
AI & LLM ToolsGoDockerText Generation WebUI
oobabooga/textgen
Gradio web UI for running large language models locally.
AI & LLM ToolsPythonDockerLibreChat
LibreChat-AI/LibreChat
Enhanced ChatGPT-compatible AI chat interface supporting multiple AI providers, with multi-user auth, message search, and plugin support.
AI & LLM ToolsTypeScriptDockerKhoj
khoj-ai/khoj
Your AI second brain. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI.
AI & LLM ToolsPythonDockerVane
ItzCrazyKns/Vane
AI-powered search engine (alternative to Perplexity AI).
AI & LLM ToolsTypeScriptDockerOnyx Community Edition
onyx-dot-app/onyx
Chat UI that works with any LLM. It comes loaded with advanced features like agents, web search, RAG, MCP, deep research, Connectors to 40+ knowledge sources, and more.
AI & LLM ToolsPythonDockerInvokeAI
invoke-ai/InvokeAI
Creative engine for Stable Diffusion models with a polished web UI.
AI & LLM ToolsTypeScriptDockerRasa
RasaHQ/rasa
Open-source framework for building contextual AI assistants and chatbots.
AI & LLM ToolsPythonDockerBotpress
botpress/botpress
Open-source platform for building conversational AI agents and chatbots.
AI & LLM ToolsTypeScriptDockerLocal Deep Research
LearningCircuit/local-deep-research
AI-powered deep research tool with multi-source search (arXiv, PubMed, web), PDF text extraction, and encrypted local storage.
AI & LLM ToolsPythonDockerAgenta
Agenta-AI/agenta
LLMOps platform for prompt management, LLM evaluation, and observability. Build, evaluate, and monitor production-grade LLM applications with collaborative prompt engineering.
AI & LLM ToolsTypeScriptDockerwhisper-asr-webservice
ahmetoner/whisper-asr-webservice
Speech recognition web service built on OpenAI Whisper.
AI & LLM ToolsPythonDockerLLM Harbor
av/harbor
Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI.
AI & LLM ToolsPythonDockerGoModel
ENTERPILOT/GoModel
AI gateway written in Go with a unified OpenAI-compatible API for multiple LLM providers, USD cost tracking, budgets, usage analytics, guardrails, caching, and an admin dashboard.
AI & LLM ToolsGoDockerLLMKube
defilantech/LLMKube
Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and…
AI & LLM ToolsGoDocker
Keep exploring
Related categories
What is the best self-hosted app for AI & LLM tools?
By GitHub stars, Ollama is the most popular self-hosted app for AI & LLM tools with 182,289 stars, followed by Stable Diffusion WebUI and Langflow. The best fit depends on your needs, so compare Docker support, license and recent activity on each app page.
Are these AI & LLM Tools apps free?
Yes. All 24 apps in this category are open source and free to run on your own server. A few also offer a paid hosted plan or enterprise add-ons, but self-hosting the open-source edition costs nothing beyond your hardware.
How do I install a self-hosted AI & LLM Tools app?
22 of the 24 apps here ship a Docker image, which is the easiest route: rent a small VPS or use a home server, install Docker, and start the app with its Docker Compose file. Apps without an image list their native install steps in the README.
Which AI & LLM Tools apps are most actively developed?
Measured by commits in the last twelve months, the most active projects are Agenta (18,955 commits), LobeHub (7,488 commits) and RAGFlow (5,821 commits). Active development usually means faster bug fixes and security patches.