6 jobs · 19 apps
Best open source AI tools for law firms
For law firms, the core of a private AI stack is Ollama for running open models locally, LibreChat for a private chat interface and RAGFlow for answering questions over your documents, all running on your own servers so client files can stay on your infrastructure. Each pick was chosen by hand for its job and is shown with GitHub data from October 2026.
Client confidentiality is the obvious reason for a law firm to keep AI in-house. A self-hosted stack lets lawyers search and summarise their own documents with open models on the firm's servers.
Updated · data from GitHub, refreshed nightly
Top picks
- Rank 1:
Ollama
ollama/ollama
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
AI & LLM ToolsGoDockerAI-nativeOllama has 182,289 GitHub stars, uses the MIT license, ships a Docker image and had 1,083 commits in the last year; it replaces ChatGPT.
- Rank 2:
LocalAI
mudler/LocalAI
Run your AI models locally and generate images and audio (alternative to OpenAI and Claude).
AI & LLM ToolsGoDockerAI-nativeLocalAI has 49,405 GitHub stars, uses the MIT license, ships a Docker image and had 3,438 commits in the last year; it replaces ChatGPT.
- Rank 3:
LLM Harbor
av/harbor
Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI.
AI & LLM ToolsPythonDockerAI-nativeLLM Harbor has 3,237 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 1,288 commits in the last year.
1 of 6 · 3 picks
Run models on your own hardware
Model runners that serve open-weight LLMs on your own CPU or GPU, with an OpenAI-compatible API the other tools can call.
- 1
Ollama
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
AI & LLM ToolsDockerAI-nativeOllama has 182,289 GitHub stars, uses the MIT license, ships a Docker image and had 1,083 commits in the last year; it replaces ChatGPT.
- 2
LocalAI
Run your AI models locally and generate images and audio (alternative to OpenAI and Claude).
AI & LLM ToolsDockerAI-nativeLocalAI has 49,405 GitHub stars, uses the MIT license, ships a Docker image and had 3,438 commits in the last year; it replaces ChatGPT.
- 3
LLM Harbor
Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI.
AI & LLM ToolsDockerAI-nativeLLM Harbor has 3,237 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 1,288 commits in the last year.
2 of 6 · 4 picks
Private chat interface
Chat front ends for your team. Point them at a local model and prompts never leave your network.
- 1
LibreChat
Enhanced ChatGPT-compatible AI chat interface supporting multiple AI providers, with multi-user auth, message search, and plugin support.
AI & LLM ToolsDockerAI-nativeLibreChat has 45,318 GitHub stars, uses the MIT license, ships a Docker image and had 2,074 commits in the last year; it replaces ChatGPT and Lovable.
- 2
Open-WebUI
User-friendly AI Interface, supports Ollama, OpenAI API.
Source-availableAI & LLM ToolsDockerAI-nativeOpen-WebUI has 154,037 GitHub stars, is source-available under the Open WebUI License (BSD-3-Clause plus branding clause) (not an open-source license), ships a Docker image and had 4,746 commits in the last year; it replaces ChatGPT and Lovable.
- 3
LobeHub
Modern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking.
Source-availableAI & LLM ToolsDockerAI-nativeLobeHub has 83,008 GitHub stars, is source-available under the LobeHub Community License (not an open-source license), ships a Docker image and had 7,488 commits in the last year; it replaces ChatGPT and Lovable.
- 4
Onyx Community Edition
Chat UI that works with any LLM. It comes loaded with advanced features like agents, web search, RAG, MCP, deep research, Connectors to 40+ knowledge sources, and more.
AI & LLM ToolsDockerAI-nativeOnyx Community Edition has 32,332 GitHub stars, uses the MIT license, ships a Docker image and had 5,771 commits in the last year.
3 of 6 · 3 picks
Questions over your documents (RAG)
Retrieval-augmented generation: index your own files and ask questions about them.
- 1
RAGFlow
Open-source RAG engine with deep document understanding.
AI & LLM ToolsDockerAI-nativeRAGFlow has 91,708 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 5,821 commits in the last year.
- 2
AnythingLLM
All-in-one desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.
AI & LLM ToolsDockerAI-nativeAnythingLLM has 66,738 GitHub stars, uses the MIT license, ships a Docker image and had 887 commits in the last year; it replaces ChatGPT.
- 3
Khoj
Your AI second brain. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI.
AI & LLM ToolsDockerAI-nativeKhoj has 37,565 GitHub stars, uses the AGPL-3.0 license, ships a Docker image and had 120 commits in the last year; it replaces ChatGPT.
4 of 6 · 4 picks
Agents and workflows
Visual builders that chain models, tools and your own APIs into agents and automations.
- 1
Langflow
Visual framework for building and deploying AI agents and RAG workflows.
AI & LLM ToolsDockerAI-nativeLangflow has 155,530 GitHub stars, uses the MIT license, ships a Docker image and had 2,486 commits in the last year.
- 2
Dify.ai
Build, test and deploy LLM applications.
Source-availableLow-code & BackendDockerAI-nativeDify.ai has 157,921 GitHub stars, is source-available under the Dify Open Source License (modified Apache 2.0) (not an open-source license), ships a Docker image and had 6,112 commits in the last year; it replaces ChatGPT and Lovable.
- 3
n8nFeatured
Free node based Workflow Automation Tool. Easily automate tasks across different services.
Source-availableAutomation & WorkflowsDockern8n has 206,738 GitHub stars, is source-available under the Sustainable Use License 1.0 (not an open-source license), ships a Docker image and had 9,029 commits in the last year; it replaces Zapier and IFTTT.
- 4
Activepieces
No-code business automation tool like Zapier or Tray. For example, you can send a Slack notification for each new Trello card.
Automation & WorkflowsDockerAI-nativeActivepieces has 24,913 GitHub stars, uses the MIT license, ships a Docker image and had 5,647 commits in the last year; it replaces Zapier and IFTTT.
5 of 6 · 3 picks
Speech and documents
Transcribe audio and turn scanned paper into searchable text before it goes into your AI stack.
- 1
whisper-asr-webservice
Speech recognition web service built on OpenAI Whisper.
AI & LLM ToolsDockerAI-nativewhisper-asr-webservice has 3,352 GitHub stars, uses the MIT license, ships a Docker image and had 31 commits in the last year.
- 2
Paperless-ngx
Scan, index, and archive all of your paper documents with an improved interface (fork of Paperless).
Document ManagementDockerAI-nativePaperless-ngx has 46,308 GitHub stars, uses the GPL-3.0 license, ships a Docker image and had 1,625 commits in the last year.
- 3
Stirling-PDF
Local hosted web application that allows you to perform various operations on PDF files, such as merging, splitting, file conversions and OCR.
Document ManagementDockerStirling-PDF has 93,634 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 1,925 commits in the last year; it replaces Adobe Acrobat.
6 of 6 · 2 picks
What to connect it to
- 1
docassemble
System for guided interviews and document assembly, based on Python, YAML, and Markdown.
Polls, Surveys & EventsDockerdocassemble has 989 GitHub stars, uses the MIT license, ships a Docker image and had 253 commits in the last year.
- 2
NextcloudFeatured
Access and share your files, calendars, contacts, mail and more from any device, on your terms.
File Sync & StorageNextcloud has 37,003 GitHub stars, uses the AGPL-3.0 license and had 7,289 commits in the last year; it replaces Google Drive and Dropbox.
What are the best open source AI tools for lawyers?
For law firms, the core of a private AI stack is Ollama for running open models locally, LibreChat for a private chat interface and RAGFlow for answering questions over your documents, all running on your own servers so client files can stay on your infrastructure. Each pick was chosen by hand for its job and is shown with GitHub data from October 2026.
Does self-hosted AI keep my data private?
It can. When the chat interface and RAG tools are pointed at a model running on your own server (for example through Ollama or LocalAI), prompts and documents are not sent to an outside AI provider, so client files stays on infrastructure you control. Several of these tools can also call cloud APIs, so check each connection you configure.
Can I rely on AI answers for legal work?
Treat them as drafts. Language models can state wrong things confidently; RAG tools reduce that by quoting your own documents, but a lawyer still has to check every answer.
Is Ollama free?
Yes. Ollama is open-source software released under the MIT license, so you can self-host it at no cost. You only pay for the server it runs on, and some projects also offer an optional paid cloud plan.
Can I run this stack with Docker?
18 of the 19 apps here publish Docker images, including Ollama, LocalAI and LLM Harbor, so most of the stack can run side by side with Docker Compose on one server. Size the server for the heaviest app and add off-site backups.
The weekly digest
New self-hosted apps, every week
Fresh releases, rising projects and one deploy guide a week. Join home labbers and engineers who self-host.