pdfGPT
pdfGPT copied to clipboard
bhaskatripathi
Fascinating - Can I run this locally with Vicuna? and any vector index?
Thanks Bhaskar - can the above be done? Happy to chat more
So I managed to run it locally but it still uses OPENAI... How can I use a local Vicuna model so that doesnt need OpenAI? Any help would be appreciated. Finally, I would like to use it over all my notes
That is great ! I think it can be run locally by Vicuna as well. I would find some time to add this feature very soon.
I would love more contributors to take up these interesting requests.
One more suggestion would be if this could be run on obsidian markdown notes! Either if I can read all the md files from within a folder or as a plug-in for obsidian. I think your implementation gives very sensible answers
yes as the code is available under a free license, you can go ahead and add support for open source model without the needs of any credits.
oh oka no problem. I will create some support for Vicuna and other open sources as I get some bandwidth.
Interesting thought, will have to try it when I get time. I tried GPT4All and the performance wasn't great. Perhaps, it might need more prompt engineering. There is a huge demand for open-source models to minimize cost
I managed to make small changes to the code to make it run with Vicuna. my PC is down, i will try to share once i reset my PC and working environnements.
