# OpenRAG

> All-in-one local stack for building and running RAG applications

OpenRAG is an open-source, local-first platform designed to build and test Retrieval-Augmented Generation pipelines without relying on external cloud APIs. It bundles document parsing, vector storage, and local LLM execution into a single Docker Compose environment with a clean web interface.

Website: https://opensourceprojects.dev/post/bd7835df-5561-42e1-ba24-b9225e80482f

## What it is for

- Run chat-over-documents locally without sending private files to external APIs
- Prototype and test RAG pipeline components on a laptop before production deployment
- Inspect document chunking, vector storage, and retrieval steps for educational or debugging purposes
- Demo a functional document Q&A assistant to team members using a prebuilt UI

## Features

- One-command deployment using Docker Compose
- Built-in web UI for document uploading and conversational querying
- Local model execution powered by Ollama and nomic-embed-text
- Vector storage and retrieval integration via ChromaDB
- Transparency across the full pipeline from chunking to prompt synthesis

## Pricing

Open source

## Details

- Type: GitHub repo
- Category: [AI](https://xiry.app/topics/ai.md)
- Open source: yes
- Platforms: Self-hosted, Linux, macOS, Windows, Web
- For: Developers and AI engineers wanting a local, self-contained environment to build and test RAG workflows.
- Alternative to: Dify, AnythingLLM, FastGPT
- Tags: rag, langflow, ollama, chromadb, local ai, docker

## Why it was saved

- [@GithubProjects, 9 March 2026](https://x.com/GithubProjects/status/2031120397513667036): Replaces the usual patchwork of ~10 tools needed for a RAG system with a single stack for building and deploying RAG applications locally

## Compare

- [Alternatives to Dify](https://xiry.app/alternatives/dify.md)

## Related

- [Local Deep Researcher](https://xiry.app/resources/local-deep-researcher-2395): Fully local web research and report writing assistant using Ollama or LMStudio (GitHub repo, Open source)
- [AgenticSeek](https://xiry.app/resources/agenticseek): Open-source, fully local autonomous AI agent that browses and writes code (GitHub repo, Open source)
- [AnythingLLM](https://xiry.app/resources/anythingllm): Private, on-device AI assistant to chat with documents and local models. (Desktop app, Open source)
- [Dolphin 3.0](https://xiry.app/resources/dolphin-3-0): Uncensored, open-source fine-tuned LLM designed for local execution without guardrails (AI model, Open source)
- [Stop Paying the OpenAI Tax: The Emerging Open-Source AI Stack](https://xiry.app/resources/stop-paying-the-openai-tax-the-emerging-open-source-ai-stack): Architectural guide breaking down developer-friendly open-source alternatives across modern AI layers (Article or course, Free)
- [ai-engineering-hub](https://xiry.app/resources/ai-engineering-hub): Open-source tutorials and project templates for LLMs, RAG, and AI agents. (GitHub repo, Open source)

Updated 10 October 2026. Page: https://xiry.app/resources/openrag

Make your own library: Xiry takes your saved reels, tweets, Reddit bookmarks and Watch Later videos, makes them searchable and pulls the useful stuff out, like this library. It's invite-only for now; join the waitlist at https://xiry.app/#waitlist.