Kevin Hu

Results 1512 comments of Kevin Hu

**`docker-compose-gpu-CN-oc9`** is not maintained any more.

[FYI](https://docs.docker.com/compose/how-tos/gpu-support/)

You could click the little lamp to have a look what exactly question changed to. ![Image](https://github.com/user-attachments/assets/3ad5ffb8-616a-40d8-b23a-eeb84f869688)

Ollama response error. Could paste the ollama error log here?

Weired! Did you set 16384 here? ![Image](https://github.com/user-attachments/assets/9c244095-0bf8-4583-9581-b6b797ab221b) And how do you know the prompt had been truncated?

You could search `BAAI/bge-large-zh-v1.5` in the codebase, and change it to the embedding model you want. But I suggest to serve embedding model via vLLM/Ollama/XInference independently.