Home
Softono
local-rag

local-rag

Open source Python
744
Stars
91
Forks
3
Issues
10
Watchers
1 week
Last Commit

About local-rag

Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network.

Platforms

Web Self-hosted

Languages

Python

Links

Local RAG

local-rag-demo

OpenSSF Best Practices GitHub Commit Activity GitHub Last Commit GitHub License

Offline, open-source retrieval augmented generation.

Ingest local files, GitHub repositories, and websites for retrieval augmented generation (RAG) with local Ollama models. Local RAG keeps chat, embeddings, and indexed source content on your machine or network.

Features:

  • Local Ollama chat models
  • Ollama or local Hugging Face embedding models
  • Multiple ingestion sources:
    • Local files
    • GitHub repositories
    • Websites
  • Streaming RAG responses through LlamaIndex
  • Browser-local settings persistence
  • Chat history export
  • Upload, URL, repository, and ingestion guardrails

Learn More: