pewjs

Results 4 comments of pewjs

Why is the occupancy of my Llama 3 model not high when using the GPU NV T2000, but instead it is computing using the CPU?

![image](https://github.com/user-attachments/assets/f7abd021-589d-4f91-b75e-8794d18e181e) I have upgraded to 0.1.36, but the result is still the same. The GPU is fluctuating, the CPU occupancy is 43%, and the output is lagging.

Why is the occupancy of my Llama 3 model not high when using the GPU NV T2000, but instead it is computing using the CPU?

2024/08/14 09:07:52 routes.go:1125: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:2m0s OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:D:\\ollama OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[* http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:*...

Why is the occupancy of my Llama 3 model not high when using the GPU NV T2000, but instead it is computing using the CPU?

sorry,I made a writing mistake. My version is v0.3.6

[Bug]: 3.14.1版本win10会导致任务栏卡死，结束进程重启任务栏就会恢复

不结束资源管理器explorer就只有80K左右的上传速度，结束资源管理器explorer，不再创建新的资源管理器explorer，就可以达到满速的状态