local-rag icon indicating copy to clipboard operation
local-rag copied to clipboard

Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network.

📚 Local RAG

local-rag-demo

OpenSSF Best Practices GitHub Commit Activity GitHub Last Commit GitHub License

Offline, Open-Source RAG

Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network.

Features:

  • Offline Embeddings & LLMs Support (No OpenAI!)
  • Support for Multiple Sources
    • Local Files
    • GitHub Repos
    • Websites
  • Streaming Responses
  • Conversational Memory
  • Chat Export

Learn More:

  • Setup & Deploy the App
  • Using Local RAG
  • RAG Pipeline
  • Planned Features
  • Troubleshooting
  • Known Bugs & Issues
  • Resources
  • Contributing