# AI for banking: open source tools you can self-host

> For banks and fintech companies, the core of a private AI stack is Ollama for running open models locally, LibreChat for a private chat interface and RAGFlow for answering questions over your documents, all running on your own servers so customer and transaction data can stay on your infrastructure. Each pick was chosen by hand for its job and is shown with GitHub data from October 2026.

## Key facts

| Fact | Value |
|---|---|
| Question | What open source AI tools can banks and fintech companies self-host? |
| Picks | 22 |
| Top pick | Ollama (182,289 stars) |
| Data as of | Oct 7, 2026 |
| Canonical URL | https://appsgit.com/best/ai-for-banking |

Financial data is often the hardest data to send to a cloud AI service. Running models and AI tools on your own servers keeps prompts, customer records and documents inside your own controls.

## Run models on your own hardware

Model runners that serve open-weight LLMs on your own CPU or GPU, with an OpenAI-compatible API the other tools can call.

- [Ollama](https://appsgit.com/apps/ollama) (182,289 stars, MIT, Go, Docker, AI features): Ollama has 182,289 GitHub stars, uses the MIT license, ships a Docker image and had 1,083 commits in the last year; it replaces ChatGPT.
- [LocalAI](https://appsgit.com/apps/localai) (49,405 stars, MIT, Go, Docker, AI features): LocalAI has 49,405 GitHub stars, uses the MIT license, ships a Docker image and had 3,438 commits in the last year; it replaces ChatGPT.
- [LLM Harbor](https://appsgit.com/apps/llm-harbor) (3,237 stars, Apache-2.0, Python, Docker, AI features): LLM Harbor has 3,237 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 1,288 commits in the last year.

## Private chat interface

Chat front ends for your team. Point them at a local model and prompts never leave your network.

- [LibreChat](https://appsgit.com/apps/librechat) (45,318 stars, MIT, TypeScript, Docker, AI features): LibreChat has 45,318 GitHub stars, uses the MIT license, ships a Docker image and had 2,074 commits in the last year; it replaces ChatGPT and Lovable.
- [Open-WebUI](https://appsgit.com/apps/open-webui) (154,037 stars, Open WebUI License, source-available, Python, Docker, AI features): Open-WebUI has 154,037 GitHub stars, is source-available under the Open WebUI License (BSD-3-Clause plus branding clause) (not an open-source license), ships a Docker image and had 4,746 commits in the last year; it replaces ChatGPT and Lovable.
- [LobeHub](https://appsgit.com/apps/lobehub) (83,008 stars, LobeHub Community License, source-available, TypeScript, Docker, AI features): LobeHub has 83,008 GitHub stars, is source-available under the LobeHub Community License (not an open-source license), ships a Docker image and had 7,488 commits in the last year; it replaces ChatGPT and Lovable.
- [Onyx Community Edition](https://appsgit.com/apps/onyx-community-edition) (32,332 stars, MIT, Python, Docker, AI features): Onyx Community Edition has 32,332 GitHub stars, uses the MIT license, ships a Docker image and had 5,771 commits in the last year.

## Questions over your documents (RAG)

Retrieval-augmented generation: index your own files and ask questions about them.

- [RAGFlow](https://appsgit.com/apps/ragflow) (91,708 stars, Apache-2.0, Go, Docker, AI features): RAGFlow has 91,708 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 5,821 commits in the last year.
- [AnythingLLM](https://appsgit.com/apps/anythingllm) (66,738 stars, MIT, JavaScript, Docker, AI features): AnythingLLM has 66,738 GitHub stars, uses the MIT license, ships a Docker image and had 887 commits in the last year; it replaces ChatGPT.
- [Khoj](https://appsgit.com/apps/khoj) (37,565 stars, AGPL-3.0, Python, Docker, AI features): Khoj has 37,565 GitHub stars, uses the AGPL-3.0 license, ships a Docker image and had 120 commits in the last year; it replaces ChatGPT.

## Agents and workflows

Visual builders that chain models, tools and your own APIs into agents and automations.

- [Langflow](https://appsgit.com/apps/langflow) (155,530 stars, MIT, Python, Docker, AI features): Langflow has 155,530 GitHub stars, uses the MIT license, ships a Docker image and had 2,486 commits in the last year.
- [Dify.ai](https://appsgit.com/apps/dify-ai) (157,921 stars, Dify Open Source License, source-available, TypeScript, Docker, AI features): Dify.ai has 157,921 GitHub stars, is source-available under the Dify Open Source License (modified Apache 2.0) (not an open-source license), ships a Docker image and had 6,112 commits in the last year; it replaces ChatGPT and Lovable.
- [n8n](https://appsgit.com/apps/n8n) (206,738 stars, Sustainable Use License, source-available, TypeScript, Docker): n8n has 206,738 GitHub stars, is source-available under the Sustainable Use License 1.0 (not an open-source license), ships a Docker image and had 9,029 commits in the last year; it replaces Zapier and IFTTT.
- [Activepieces](https://appsgit.com/apps/activepieces) (24,913 stars, MIT, TypeScript, Docker, AI features): Activepieces has 24,913 GitHub stars, uses the MIT license, ships a Docker image and had 5,647 commits in the last year; it replaces Zapier and IFTTT.

## LLM observability and gateways

Trace prompts, measure cost and evaluate answers once AI features reach production.

- [Langfuse](https://appsgit.com/apps/langfuse) (35,416 stars, MIT, TypeScript, Docker, AI features): Langfuse has 35,416 GitHub stars, uses the MIT license, ships a Docker image and had 4,298 commits in the last year; it replaces Sentry.
- [Opik](https://appsgit.com/apps/opik) (22,399 stars, Apache-2.0, Python, Docker, AI features): Opik has 22,399 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 3,961 commits in the last year.
- [Agenta](https://appsgit.com/apps/agenta) (4,807 stars, MIT, TypeScript, Docker, AI features): Agenta has 4,807 GitHub stars, uses the MIT license, ships a Docker image and had 18,955 commits in the last year.
- [GoModel](https://appsgit.com/apps/gomodel) (1,219 stars, MIT, Go, Docker, AI features): GoModel has 1,219 GitHub stars, uses the MIT license, ships a Docker image and had 657 commits in the last year.

## What to connect it to

- [Metabase](https://appsgit.com/apps/metabase) (49,547 stars, AGPL-3.0, Clojure, Docker): Metabase has 49,547 GitHub stars, uses the AGPL-3.0 license, ships a Docker image and had 6,378 commits in the last year; it replaces Metabase Cloud and Tableau.
- [HyperSwitch](https://appsgit.com/apps/hyperswitch) (45,286 stars, Apache-2.0, Rust, Docker): HyperSwitch has 45,286 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 2,103 commits in the last year.
- [Lago](https://appsgit.com/apps/lago) (10,657 stars, AGPL-3.0, Go, Docker): Lago has 10,657 GitHub stars, uses the AGPL-3.0 license, ships a Docker image and had 174 commits in the last year.
- [Bigcapital](https://appsgit.com/apps/bigcapital) (3,921 stars, AGPL-3.0, TypeScript, Docker): Bigcapital has 3,921 GitHub stars, uses the AGPL-3.0 license, ships a Docker image and had 1,005 commits in the last year; it replaces QuickBooks and Xero.

## How this list was made

- Apps were picked by hand from the appsgit catalog for each job, then checked against the snapshot: unknown or archived projects and projects with no commit in two years are dropped automatically.
- Inside each section the curated order is kept, most broadly useful first; an app appears only once on the page.
- Stars, license, Docker and activity facts come from the GitHub API as of October 2026.
- Source-available apps are labelled; they are not open source, so read their licenses before commercial use.

## FAQ

### Does self-hosted AI keep my data private?

It can. When the chat interface and RAG tools are pointed at a model running on your own server (for example through Ollama or LocalAI), prompts and documents are not sent to an outside AI provider, so customer and transaction data stays on infrastructure you control. Several of these tools can also call cloud APIs, so check each connection you configure.

### Does self-hosted AI make a bank compliant?

No tool does that on its own. Keeping data on your servers helps with data residency and third-party risk, but you still need model risk management, access control, logging and review under your regulator's rules. This page is not legal or compliance advice.

### Is Ollama free?

Yes. Ollama is open-source software released under the MIT license, so you can self-host it at no cost. You only pay for the server it runs on, and some projects also offer an optional paid cloud plan.

### Can I run this stack with Docker?

All 22 apps here publish Docker images, including Ollama, LocalAI and LLM Harbor, so most of the stack can run side by side with Docker Compose on one server. Size the server for the heaviest app and add off-site backups.

## Related questions

- [What is the best open source software for banks and fintech companies?](https://appsgit.com/best/open-source-software-for-fintech)
- [What is the best open source software for hospitals and healthcare?](https://appsgit.com/best/open-source-software-for-hospitals)
- [What are the best open source AI tools for hospitals?](https://appsgit.com/best/ai-tools-for-hospitals)
- [What is the best open source software for e-commerce and retail?](https://appsgit.com/best/open-source-software-for-ecommerce)
- [What are the best open source AI tools for e-commerce stores?](https://appsgit.com/best/ai-tools-for-ecommerce)
- [What is the best open source software for real estate agencies?](https://appsgit.com/best/open-source-software-for-real-estate)
- [What are the best open source AI tools for real estate agents?](https://appsgit.com/best/ai-tools-for-real-estate)
- [What is the best open source AI CRM?](https://appsgit.com/best/ai-crm)

## See also

- [All AI & LLM tools apps](https://appsgit.com/categories/ai-tools)
- [All low-code & backend apps](https://appsgit.com/categories/low-code)
- [All automation & workflows apps](https://appsgit.com/categories/automation)
- [All developer tools apps](https://appsgit.com/categories/developer-tools)
- [Open-source alternatives to ChatGPT](https://appsgit.com/alternatives/chatgpt)
- [Open-source alternatives to Lovable](https://appsgit.com/alternatives/lovable)
- [Open-source alternatives to Zapier](https://appsgit.com/alternatives/zapier)
- [Open-source alternatives to IFTTT](https://appsgit.com/alternatives/ifttt)
- [Open-source alternatives to Buffer / Hootsuite](https://appsgit.com/alternatives/hootsuite)
- [Open-source alternatives to Sentry](https://appsgit.com/alternatives/sentry)
- [Ollama vs LocalAI](https://appsgit.com/compare/ollama-vs-localai)
- [Open WebUI vs LibreChat](https://appsgit.com/compare/open-webui-vs-librechat)
- [n8n vs Activepieces](https://appsgit.com/compare/n8n-vs-activepieces)
- [n8n vs Node-RED](https://appsgit.com/compare/n8n-vs-node-red)
- [n8n vs Huginn](https://appsgit.com/compare/n8n-vs-huginn)
- [Grafana vs Metabase](https://appsgit.com/compare/grafana-vs-metabase)
- [How to self-host Ollama with Docker Compose](https://appsgit.com/guides/ollama)
- [How to self-host Open WebUI with Docker Compose](https://appsgit.com/guides/open-webui)
- [How to self-host n8n with Docker Compose](https://appsgit.com/guides/n8n)

---

Canonical page: https://appsgit.com/best/ai-for-banking
Source: appsgit (https://appsgit.com), the app store for github. Data from the GitHub API, refreshed nightly.
Machine access: JSON API https://appsgit.com/api/v1/apps (OpenAPI: https://appsgit.com/openapi.json), MCP server https://mcp.appsgit.com/mcp, full index https://appsgit.com/llms-full.txt.