6 jobs · 22 apps
AI for banking: open source tools you can self-host
For banks and fintech companies, the core of a private AI stack is Ollama for running open models locally, LibreChat for a private chat interface and RAGFlow for answering questions over your documents, all running on your own servers.
Pointed at a model on your own hardware, these tools keep customer and transaction data on your infrastructure.
Financial data is often the hardest data to send to a cloud AI service. Running models and AI tools on your own servers keeps prompts, customer records and documents inside your own controls.
Updated · data from GitHub, refreshed daily
Top picks
- Rank 1:
Ollama
ollama/ollama
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
Active · last commit Nov 18, 2026
AI & LLM ToolsGoDockerAI-nativeStands out for the most GitHub stars. Ollama has 187,500 GitHub stars, uses the MIT license, ships a Docker image and had 1,199 commits in the last year; it replaces ChatGPT.
- Rank 2:
LocalAI
mudler/LocalAI
Run your AI models locally and generate images and audio (alternative to OpenAI and Claude).
Active · last commit Nov 18, 2026
AI & LLM ToolsGoDockerAI-nativeStands out for a permissive MIT license. LocalAI has 50,430 GitHub stars, uses the MIT license, ships a Docker image and had 5,147 commits in the last year; it replaces ChatGPT.
- Rank 3:
LLM Harbor
av/harbor
Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI.
Active · last commit Nov 11, 2026
AI & LLM ToolsPythonDockerAI-nativeStands out for a permissive Apache-2.0 license. LLM Harbor has 3,280 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 1,337 commits in the last year.
At a glance
AI for banking: open source tools you can self-host compared
Picked by hand for each job from apps whose own description or topics match it, in curated order inside each section, with GitHub data from November 2026; an app appears only once.
| App | Stands out for | License | GitHub stars | Commits (12 mo) | Last commit | Docker image |
|---|---|---|---|---|---|---|
| Ollama | the most GitHub stars | MIT | 187,500 | 1,199 | Nov 18, 2026 | Yes |
| LocalAI | a permissive MIT license | MIT | 50,430 | 5,147 | Nov 18, 2026 | Yes |
| LLM Harbor | a permissive Apache-2.0 license | Apache-2.0 | 3,280 | 1,337 | Nov 11, 2026 | Yes |
| LibreChat | AI features named in its own description | MIT | 47,310 | 3,592 | Nov 17, 2026 | Yes |
| Open-WebUI | the most commits in the last 12 months (6,788) | source-available, Open WebUI License (BSD-3-Clause plus branding clause) | 159,000 | 6,788 | Nov 18, 2026 | Yes |
| LobeHub | – | source-available, LobeHub Community License | 85,748 | 9,314 | Nov 18, 2026 | Yes |
| Onyx Community Edition | – | MIT | 33,450 | 6,922 | Nov 18, 2026 | Yes |
| RAGFlow | – | Apache-2.0 | 94,375 | 6,601 | Nov 18, 2026 | Yes |
| AnythingLLM | – | MIT | 68,392 | 1,143 | Nov 18, 2026 | Yes |
| Khoj | – | AGPL-3.0 | 38,166 | 91 | Aug 2, 2026 | Yes |
1 of 6 · 3 picks
Run models on your own hardware
Model runners that serve open-weight LLMs on your own CPU or GPU, with an OpenAI-compatible API the other tools can call.
- 1
Ollama
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
AI & LLM ToolsDockerAI-nativeStands out for the most GitHub stars. Ollama has 187,500 GitHub stars, uses the MIT license, ships a Docker image and had 1,199 commits in the last year; it replaces ChatGPT.
- 2
LocalAI
Run your AI models locally and generate images and audio (alternative to OpenAI and Claude).
AI & LLM ToolsDockerAI-nativeStands out for a permissive MIT license. LocalAI has 50,430 GitHub stars, uses the MIT license, ships a Docker image and had 5,147 commits in the last year; it replaces ChatGPT.
- 3
LLM Harbor
Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI.
AI & LLM ToolsDockerAI-nativeStands out for a permissive Apache-2.0 license. LLM Harbor has 3,280 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 1,337 commits in the last year.
2 of 6 · 4 picks
Private chat interface
Chat front ends for your team. Point them at a local model and prompts never leave your network.
- 1
LibreChat
Enhanced ChatGPT-compatible AI chat interface supporting multiple AI providers, with multi-user auth, message search, and plugin support.
AI & LLM ToolsDockerAI-nativeStands out for AI features named in its own description. LibreChat has 47,310 GitHub stars, uses the MIT license, ships a Docker image and had 3,592 commits in the last year; it replaces ChatGPT and Lovable.
- 2
Open-WebUI
User-friendly AI Interface, supports Ollama, OpenAI API.
Source-availableAI & LLM ToolsDockerAI-nativeStands out for the most commits in the last 12 months (6,788). Open-WebUI has 159,000 GitHub stars, is source-available under the Open WebUI License (BSD-3-Clause plus branding clause) (not an open-source license), ships a Docker image and had 6,788 commits in the last year; it replaces ChatGPT and Lovable.
- 3
LobeHub
Modern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking.
Source-availableAI & LLM ToolsDockerAI-nativeLobeHub has 85,748 GitHub stars, is source-available under the LobeHub Community License (not an open-source license), ships a Docker image and had 9,314 commits in the last year; it replaces ChatGPT and Lovable.
- 4
Onyx Community Edition
Chat UI that works with any LLM. It comes loaded with advanced features like agents, web search, RAG, MCP, deep research, Connectors to 40+ knowledge sources, and more.
AI & LLM ToolsDockerAI-nativeOnyx Community Edition has 33,450 GitHub stars, uses the MIT license, ships a Docker image and had 6,922 commits in the last year.
3 of 6 · 3 picks
Questions over your documents (RAG)
Retrieval-augmented generation: index your own files and ask questions about them.
- 1
RAGFlow
Open-source RAG engine with deep document understanding.
AI & LLM ToolsDockerAI-nativeRAGFlow has 94,375 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 6,601 commits in the last year.
- 2
AnythingLLM
All-in-one desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.
AI & LLM ToolsDockerAI-nativeAnythingLLM has 68,392 GitHub stars, uses the MIT license, ships a Docker image and had 1,143 commits in the last year; it replaces ChatGPT.
- 3
Khoj
Your AI second brain. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI.
AI & LLM ToolsDockerAI-nativeKhoj has 38,166 GitHub stars, uses the AGPL-3.0 license, ships a Docker image and had 91 commits in the last year; it replaces ChatGPT.
4 of 6 · 4 picks
Agents and workflows
Visual builders that chain models, tools and your own APIs into agents and automations.
- 1
Langflow
Visual framework for building and deploying AI agents and RAG workflows.
AI & LLM ToolsDockerAI-nativeLangflow has 156,734 GitHub stars, uses the MIT license, ships a Docker image and had 2,803 commits in the last year.
- 2
Dify.ai
Build, test and deploy LLM applications.
Source-availableLow-code & BackendDockerAI-nativeDify.ai has 161,407 GitHub stars, is source-available under the Dify Open Source License (modified Apache 2.0) (not an open-source license), ships a Docker image and had 7,494 commits in the last year.
- 3
n8nFeatured
Free node based Workflow Automation Tool. Easily automate tasks across different services.
Source-availableAutomation & WorkflowsDockern8n has 210,807 GitHub stars, is source-available under the Sustainable Use License 1.0 (not an open-source license), ships a Docker image and had 11,277 commits in the last year; it replaces Zapier and IFTTT.
- 4
Activepieces
No-code business automation tool like Zapier or Tray. For example, you can send a Slack notification for each new Trello card.
Automation & WorkflowsDockerAI-nativeActivepieces has 25,600 GitHub stars, uses the MIT license, ships a Docker image and had 5,741 commits in the last year; it replaces Zapier and IFTTT.
5 of 6 · 4 picks
LLM observability and gateways
Trace prompts, measure cost and evaluate answers once AI features reach production.
- 1
Langfuse
LLM engineering platform for model tracing, prompt management, and application evaluation. Langfuse helps teams collaboratively debug, analyze, and iterate on their LLM applications such as chatbots…
Developer ToolsDockerAI-nativeLangfuse has 37,583 GitHub stars, uses the MIT license, ships a Docker image and had 5,516 commits in the last year; it replaces Sentry.
- 2
Opik
Evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.
API ManagementDockerAI-nativeOpik has 23,448 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 4,413 commits in the last year.
- 3
Agenta
LLMOps platform for prompt management, LLM evaluation, and observability. Build, evaluate, and monitor production-grade LLM applications with collaborative prompt engineering.
AI & LLM ToolsDockerAI-nativeAgenta has 4,915 GitHub stars, uses the MIT license, ships a Docker image and had 22,895 commits in the last year.
- 4
GoModel
AI gateway written in Go with a unified OpenAI-compatible API for multiple LLM providers, USD cost tracking, budgets, usage analytics, guardrails, caching, and an admin dashboard.
AI & LLM ToolsDockerAI-nativeGoModel has 1,322 GitHub stars, uses the MIT license, ships a Docker image and had 1,353 commits in the last year.
6 of 6 · 4 picks
What to connect it to
- 1
Metabase
Easy way for everyone in your company to ask questions and learn from data.
AnalyticsDockerMetabase has 50,395 GitHub stars, uses the AGPL-3.0 license, ships a Docker image and had 7,490 commits in the last year; it replaces Metabase Cloud and Tableau.
- 2
HyperSwitch
Payment switch to make payments fast, reliable and affordable. Connect with multiple payment processors and route traffic effortlessly, all with a single API integration.
Finance & BudgetingDockerHyperSwitch has 45,811 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 2,346 commits in the last year.
- 3
Lago
Metering and usage-based billing.
Accounting & InvoicingDockerLago has 10,896 GitHub stars, uses the AGPL-3.0 license, ships a Docker image and had 233 commits in the last year.
- 4
Bigcapital
Financial accounting and inventory management software for small to medium businesses.
Accounting & InvoicingDockerBigcapital has 4,227 GitHub stars, uses the AGPL-3.0 license, ships a Docker image and had 1,276 commits in the last year; it replaces QuickBooks and Xero.
Does self-hosted AI keep my data private?
It can. When the chat interface and RAG tools are pointed at a model running on your own server (for example through Ollama or LocalAI), prompts and documents are not sent to an outside AI provider, so customer and transaction data stays on infrastructure you control. Several of these tools can also call cloud APIs, so check each connection you configure.
Does self-hosted AI make a bank compliant?
No tool does that on its own. Keeping data on your servers helps with data residency and third-party risk, but you still need model risk management, access control, logging and review under your regulator's rules. This page is not legal or compliance advice.
Is Ollama free?
Yes. Ollama is open-source software released under the MIT license, so you can self-host it at no cost. You only pay for the server it runs on, and some projects also offer an optional paid cloud plan.
Can I run this stack with Docker?
All 22 apps here publish Docker images, including Ollama, LocalAI and LLM Harbor, so most of the stack can run side by side with Docker Compose on one server. Size the server for the heaviest app and add off-site backups.
How is this list ranked?
Picked by hand for each job from apps whose own description or topics match it, in curated order inside each section, with GitHub data from November 2026; an app appears only once.
The weekly digest
New self-hosted apps, every week
Fresh releases, rising projects and one deploy guide a week. Join home labbers and engineers who self-host.