fully-local-pdf-chatbot icon indicating copy to clipboard operation
fully-local-pdf-chatbot copied to clipboard

Published 20 hours ago • verified publisher icon jacoblee93

Allow us to specify which Ollama model to use

Open aviaryan opened this issue 1 year ago • 4 comments

I don't think there is a hard requirement to only use Mistral. Can we have a feature to use any Ollama model? I would like to use llama3 or phi3 for example.

Screenshot 2024-08-01 at 7 56 23 PM

aviaryan avatar Aug 01 '24 14:08 aviaryan

Yes would be nice! As a short term workaround you can modify the source code.

jacoblee93 avatar Aug 01 '24 15:08 jacoblee93

Yes, I did that. Thanks!

aviaryan avatar Aug 01 '24 16:08 aviaryan

Can you show me where is I can change source code?

iqs-systems avatar Aug 08 '24 15:08 iqs-systems

Here:

https://github.com/jacoblee93/fully-local-pdf-chatbot/blob/main/components/ChatWindow.tsx#L116

jacoblee93 avatar Aug 08 '24 15:08 jacoblee93