Sparkchen85 comments

Results 1 comments of


                                            Sparkchen85

[Bug]: I am traing to run unsloth/phi-4-bnb-4bit but I am getting always the same error Validation Error:1 validatiopn error for modelconfig Infer_schema(func): Parameter block_size has unsupported type list[int]

> I'm using 2 AMD Radeon 7900 XTX video cards and I get this error when starting any model: > > ``` > vllm serve /app/model/Qwen2.5-Coder-14B-Instruct --port 8002 --tensor-parallel-size 2...