AI for banking: open source tools you can self-host

1

Ollama

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

AI & LLM ToolsDocker

185k

AI-nativeStands out for the most GitHub stars. Ollama has 185,075 GitHub stars, uses the MIT license, ships a Docker image and had 1,263 commits in the last year; it replaces ChatGPT.

2

LocalAI

Run your AI models locally and generate images and audio (alternative to OpenAI and Claude).

AI & LLM ToolsDocker

50k

AI-nativeStands out for a permissive MIT license. LocalAI has 50,019 GitHub stars, uses the MIT license, ships a Docker image and had 3,909 commits in the last year; it replaces ChatGPT.

3

LLM Harbor

Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI.

AI & LLM ToolsDocker

3.3k

AI-nativeStands out for a permissive Apache-2.0 license. LLM Harbor has 3,256 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 1,315 commits in the last year.

1

LibreChat

Enhanced ChatGPT-compatible AI chat interface supporting multiple AI providers, with multi-user auth, message search, and plugin support.

AI & LLM ToolsDocker

46k

AI-nativeStands out for AI features named in its own description. LibreChat has 46,409 GitHub stars, uses the MIT license, ships a Docker image and had 3,220 commits in the last year; it replaces ChatGPT and Lovable.

2

Open-WebUI

User-friendly AI Interface, supports Ollama, OpenAI API.

Source-availableAI & LLM ToolsDocker

157k

AI-nativeStands out for the most commits in the last 12 months (6,037). Open-WebUI has 157,004 GitHub stars, is source-available under the Open WebUI License (BSD-3-Clause plus branding clause) (not an open-source license), ships a Docker image and had 6,037 commits in the last year; it replaces ChatGPT and Lovable.

3

LobeHub

Modern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking.

Source-availableAI & LLM ToolsDocker

84k

AI-nativeLobeHub has 83,550 GitHub stars, is source-available under the LobeHub Community License (not an open-source license), ships a Docker image and had 8,610 commits in the last year; it replaces ChatGPT and Lovable.

4

Onyx Community Edition

Chat UI that works with any LLM. It comes loaded with advanced features like agents, web search, RAG, MCP, deep research, Connectors to 40+ knowledge sources, and more.

AI & LLM ToolsDocker

33k

AI-nativeOnyx Community Edition has 33,042 GitHub stars, uses the MIT license, ships a Docker image and had 6,557 commits in the last year.

1

RAGFlow

Open-source RAG engine with deep document understanding.

AI & LLM ToolsDocker

93k

AI-nativeRAGFlow has 92,997 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 6,295 commits in the last year.

2

AnythingLLM

All-in-one desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.

AI & LLM ToolsDocker

68k

AI-nativeAnythingLLM has 67,665 GitHub stars, uses the MIT license, ships a Docker image and had 998 commits in the last year; it replaces ChatGPT.

3

Khoj

Your AI second brain. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI.

AI & LLM ToolsDocker

38k

AI-nativeKhoj has 37,865 GitHub stars, uses the AGPL-3.0 license, ships a Docker image and had 120 commits in the last year; it replaces ChatGPT.

1

Langflow

Visual framework for building and deploying AI agents and RAG workflows.

AI & LLM ToolsDocker

156k

AI-nativeLangflow has 156,084 GitHub stars, uses the MIT license, ships a Docker image and had 2,758 commits in the last year.

2

Dify.ai

Build, test and deploy LLM applications.

Source-availableLow-code & BackendDocker

160k

AI-nativeDify.ai has 159,780 GitHub stars, is source-available under the Dify Open Source License (modified Apache 2.0) (not an open-source license), ships a Docker image and had 6,840 commits in the last year.

3

n8nFeatured

Free node based Workflow Automation Tool. Easily automate tasks across different services.

Source-availableAutomation & WorkflowsDocker

209k

n8n has 208,840 GitHub stars, is source-available under the Sustainable Use License 1.0 (not an open-source license), ships a Docker image and had 10,360 commits in the last year; it replaces Zapier and IFTTT.

4

Activepieces

No-code business automation tool like Zapier or Tray. For example, you can send a Slack notification for each new Trello card.

Automation & WorkflowsDocker

25k

AI-nativeActivepieces has 25,258 GitHub stars, uses the MIT license, ships a Docker image and had 6,366 commits in the last year; it replaces Zapier and IFTTT.

1

Langfuse

LLM engineering platform for model tracing, prompt management, and application evaluation. Langfuse helps teams collaboratively debug, analyze, and iterate on their LLM applications such as chatbots…

Developer ToolsDocker

37k

AI-nativeLangfuse has 36,628 GitHub stars, uses the MIT license, ships a Docker image and had 5,125 commits in the last year; it replaces Sentry.

2

Opik

Evaluate, test, and ship LLM applications with a suite of observability tools to calibrate language model outputs across your dev and production lifecycle.

API ManagementDocker

23k

AI-nativeOpik has 22,980 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 4,455 commits in the last year.

3

Agenta

LLMOps platform for prompt management, LLM evaluation, and observability. Build, evaluate, and monitor production-grade LLM applications with collaborative prompt engineering.

AI & LLM ToolsDocker

4.9k

AI-nativeAgenta has 4,868 GitHub stars, uses the MIT license, ships a Docker image and had 21,140 commits in the last year.

4

GoModel

AI gateway written in Go with a unified OpenAI-compatible API for multiple LLM providers, USD cost tracking, budgets, usage analytics, guardrails, caching, and an admin dashboard.

AI & LLM ToolsDocker

1.3k

AI-nativeGoModel has 1,280 GitHub stars, uses the MIT license, ships a Docker image and had 1,218 commits in the last year.

1

Metabase

Easy way for everyone in your company to ask questions and learn from data.

AnalyticsDocker

50k

Metabase has 49,881 GitHub stars, uses the AGPL-3.0 license, ships a Docker image and had 7,206 commits in the last year; it replaces Metabase Cloud and Tableau.

2

HyperSwitch

Payment switch to make payments fast, reliable and affordable. Connect with multiple payment processors and route traffic effortlessly, all with a single API integration.

Finance & BudgetingDocker

45k

HyperSwitch has 45,422 GitHub stars, uses the Apache-2.0 license, ships a Docker image and had 2,323 commits in the last year.

3

Lago

Metering and usage-based billing.

Accounting & InvoicingDocker

11k

Lago has 10,714 GitHub stars, uses the AGPL-3.0 license, ships a Docker image and had 199 commits in the last year.

4

Bigcapital

Financial accounting and inventory management software for small to medium businesses.

Accounting & InvoicingDocker

4.0k

Bigcapital has 3,970 GitHub stars, uses the AGPL-3.0 license, ships a Docker image and had 1,135 commits in the last year; it replaces QuickBooks and Xero.