Project: Copilots on the Edge with Local RAG

[arafattehsin]

Project Name

Local RAG

Description

It's an art of the possible which shows how you can consume Phi-3 locally on the edge without using any intranet / internet services, all using file-based ONNX Runtime powered by Semantic Kernel and Kernel Memory. Additionally, if you want, you can additional ingest the online documents to make it a part of your RAG pipeline.

Technology & Languages

• [ ] JavaScript
• [ ] Java
• [X] .NET
• [ ] Python
• [ ] AI Studio
• [ ] AI Search
• [ ] PostgreSQL
• [ ] Cosmos DB
• [ ] Azure SQL

Project Repository URL

https://github.com/arafattehsin/generative-ai/tree/main/samples/dotnet/local-rag-sk

Deployed Endpoint URL

No response

Project Video

https://arafattehsin.com/wp-content/uploads/2024/08/LocalRAG.gif

Team Members

Arafat Tehsin

[multispark]

Hello @arafattehsin, thank you for participating in RAG Hack!

The team is working hard to distribute badges. Please have each team member fill out this form: aka.ms/raghack/badge-dist

Thank you!