Anton Volnuhin

Results 3 comments of Anton Volnuhin

I have the same problem with all 8x22 models, num_gpu 0 helps, but makes them very slow (since GPU does not seem to work full throttle in that case)

I have exactly the same bug. Everything hangs on any shell exec

I second that, right now it seems impossible to use ollama's multimodal capabilities from command line for scripting or something like that