小h

icon indicating a website link https://www.xhsysu.edu.cn/

icon company Guangzhou Xinhua University icon location China Guangzhou icon location Guangzhou Xinhua University/major in Computer Science and Technology

Results 2 comments of 小h

[Bug]: Use much more VRAM to chat with Ollama models than running in cmd

> i handled my problem after setting OLLAMA_NUM_GPU=1 and updating ollama to latest version still can't do it. May I ask if you have configured anything else, such as environment...

[Question]: The VRAM usage when running the model with ragflow is much higher than when running it with ollama run qwen3:14b.

> Based on the information available, there are a few key factors that could explain the increased VRAM usage in ragflow versions 0.18 and 0.19 compared to version 0.17 and...