NikosDi
NikosDi
Intel Arc A380 using WhisperDesktop v1.12 medium.en model: 93 sec large-v1 model: 171 sec @emcodem What app did you use for large v2 model ? Because I think WhisperDesktop is...
Yes, I tried both and work fine too with my A380 - large-v1 and large (v2) Large (v2) is a little slower, but probably more accurate. The reason I asked...
@GamerSocke Use `OLLAMA_NUM_PARALLEL=1` in your script just before `ollama serve` I have also an Intel ARC A380 and it's the only way to load a model in 6GB VRAM I...