DjToMeK30

Yes, windows I just started Flutter development last week. Yesterday it asked me to update Flutter, so I did Then I tried your example and this happens. Lib folder is...

Oh ok thank you. I just wanted to try Android side on Windows to see if it is viable option and to test Android code and later try on MAC...

@shaggy2626 I used this method https://github.com/imartinez/privateGPT/issues/220#issuecomment-1550376561 pip install llama-cpp-python==0.1.48 Then I changed MODEL_N_CTX=2048 I also applied this method https://github.com/imartinez/privateGPT/issues/517#issuecomment-1566858642 Now it works better but only with PDF I think. CSV...

I use MODEL_TYPE=LlamaCpp MODEL_PATH=ggml-old-vic13b-q5_1.bin But yeah, it takes about 2-3min for a response. It starts loading model in memory. I have 32gb But whole response is crap, on my side....

> Just for comparison, I am using wizard Vicuna 13GB ggml but I am using it with GPU implementation where some of the work gets off loaded. Answers take about...

@StephenDWright thanks for the follow up. I was wondering what type of graphic card would I need to make this somehow usable. I don't think my GPU would handle it...

> > @StephenDWright thanks for the follow up. I was wondering what type of graphic card would I need to make this somehow usable. I don't think my GPU would...

@ChapmanKU in ingest.py you have `source_directory = os.environ.get('SOURCE_DIRECTORY', 'source_documents')` Here it looks for system environment variable SOURCE_DIRECTORY if it is set if not it looks into source_documents You can specify...

Yes, that is why I said he can change system env first... But sometimes you don't want to do that or don't need it if you want to quickly check...