skb888

Ollama deepseek-r1 or qwen3 not work

9

### What happened? How to solve the issue of models not found in litellm's model list? holmes version 0.16.0 ollama list NAME ID SIZE MODIFIED deepseek-r1:8b 6995872bfe4c 5.2 GB 28...

multi-node download-model-to-pvc.yaml example not exist

8

I follow the instruction: https://kserve.github.io/website/docs/model-serving/generative-inference/multi-node#2-download-the-model-to-the-pvc For this step: 2. Download the Model to the PVC curl -o download-model-to-pvc.yaml https://kserve.github.io/website/latest/modelserving/v1beta1/vLLM/huggingface/multi-node/download-model-to-pvc.yaml It seems that the given link not work, can not download...

LLMs Fine-Tuning Errors in llm worker pod with pytorch conatiner

5

Hi Team, I follow the instruction to run the LLM fine tuning, but faces below errors. It comes from **kubectl logs pod llama-ppwtq5t2-worker-0 -n -c pytorch** !pip install -U kubeflow-katib...