Home
Softono

Local Rag

Open source Python
744
Stars
91
Forks
3
Issues
10
Watchers
2 months
Last Commit

 About Local Rag

Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network.

Platforms

Web Self-hosted

Languages

Python

Links

Need Help Installing Local Rag?

We provide expert installation service for this software. Our team will install, configure, and secure Local Rag on your server. plans start at just $30.

Local RAG

local-rag-demo

OpenSSF Best Practices GitHub Commit Activity GitHub Last Commit GitHub License

Offline, open-source retrieval augmented generation.

Ingest local files, GitHub repositories, and websites for retrieval augmented generation (RAG) with local Ollama models. Local RAG keeps chat, embeddings, and indexed source content on your machine or network.

Features:

  • Local Ollama chat models
  • Ollama or local Hugging Face embedding models
  • Multiple ingestion sources:
    • Local files
    • GitHub repositories
    • Websites
  • Streaming RAG responses through LlamaIndex
  • Browser-local settings persistence
  • Chat history export
  • Upload, URL, repository, and ingestion guardrails

Learn More: