vincent-wsz

Qwen2 Deployment by Ollama fail

2

Qwen2 Deployment by Ollama fail,prompt"Ollama_llama_server无法找到入口"  Test environment：Ultra 5 125H CPU，Win11 23H2 Pro，gfx driver-32.0.101.5972 These are the pip list in my container:  Installation Steps： 1. install Miniforge3-Windows-x86_64.exe，VSCodeUserSetup-x64-1.89.1.exe，w_BaseKit_p_2024.1.0.595.exe...

LLM benchmark for chatglm3-6b Unable to run properly

1

Run LLM benchmark for chatglm3-6b , prompt“OSError: [WinError 126] 找不到指定的模块。 Error loading "D:\miniforge3\envs\llm\Lib\site-packages\intel_extension_for_pytorch\bin\intel-ext-pt-gpu.dll" or one of its dependencies.”  Test environment：Ultra 5 125H CPU，Win11 23H2 Pro，gfx driver-32.0.101.5972 These are the...