retrieval augmented generation (RAG) proof of concept

[psugihara]

I want to be able to do RAG with a set of local files or even my whole filesystem. As a proof of concept, let's try giving FreeChat a long term memory by doing context retrieval from all past messages.

• [ ] embed/index messages in some kind of vector db
• [ ] when a user does a query, search for relevant messages and put them in the system prompt or append to the user's message

The whole thing should of course have no installation steps for users.