Self-hosted Generative Artificial Intelligence (GenAI) software
Generative Artificial Intelligence (GenAI) is a subset of artificial intelligence that uses generative models to produce text, images, videos, or other forms of data.
14 projects, sorted by GitHub stars (as recorded in the dataset). Star counts and dates come from the dataset snapshot, not live.
| Name | Description | License | Stars | Updated | Platforms | |
|---|---|---|---|---|---|---|
| Ollama | Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models. | MIT | 184,072 | 2026-10-20 | Docker, Python | Source |
| Open-WebUI | User-friendly AI Interface, supports Ollama, OpenAI API. | BSD-3-Clause | 156,304 | 2026-10-16 | Docker, Python | Source |
| LobeHub | Modern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking. | ⊘ Proprietary (non-free) | 83,367 | 2026-10-20 | Nodejs, Docker | Source |
| AnythingLLM | All-in-one desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more. | MIT | 67,365 | 2026-10-20 | Nodejs, Docker | Source |
| LocalAI | Run your AI models locally and generate images and audio (alternative to OpenAI and Claude). | MIT | 49,798 | 2026-10-20 | Docker, K8S | Source |
| LibreChat | Enhanced ChatGPT-compatible AI chat interface supporting multiple AI providers, with multi-user auth, message search, and plugin support. | MIT | 46,087 | 2026-10-17 | Nodejs, Docker | Source |
| Khoj | Your AI second brain. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI. | AGPL-3.0 | 37,763 | 2026-08-02 | Python, Docker | Source |
| Vane | AI-powered search engine (alternative to Perplexity AI). | MIT | 37,551 | 2026-09-01 | Docker | Source |
| Onyx Community Edition | Chat UI that works with any LLM. It comes loaded with advanced features like agents, web search, RAG, MCP, deep research, Connectors to 40+ knowledge sources, and more. | MIT | 32,610 | 2026-10-21 | Docker, K8S | Source |
| Local Deep Research | AI-powered deep research tool with multi-source search (arXiv, PubMed, web), PDF text extraction, and encrypted local storage. | MIT | 9,372 | 2026-10-19 | Docker, Python | Source |
| Agenta | LLMOps platform for prompt management, LLM evaluation, and observability. Build, evaluate, and monitor production-grade LLM applications with collaborative prompt engineering. | MIT | 4,848 | 2026-10-20 | Docker | Source |
| LLM Harbor | Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI. | Apache-2.0 | 3,248 | 2026-10-20 | Docker, Shell | Source |
| GoModel | AI gateway written in Go with a unified OpenAI-compatible API for multiple LLM providers, USD cost tracking, budgets, usage analytics, guardrails, caching, and an admin dashboard. | MIT | 1,258 | 2026-10-20 | Go, Docker | Source |
| LLMKube | Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API. | Apache-2.0 | 241 | 2026-10-21 | Go, Docker, K8S | Source |