PhilGlau

Results 33 comments of PhilGlau

Awesome. Thanks. I'll give it a try later today. What performance boost did the GPU code give over the Numpy based CPU version ?

I removed the GPU and it OOMs (main memory) when using Numpy as well. Set num of worker between 0 and 6. The only difference is the speed at which...

To follow up on @0xlws2's comment: I did the following to get it to work on my local ollama server: ``` // install the "langchain_ollama" package as it's not already...