Grey4sh

[email protected]

ByteDance Beijing Code LLM, Reasoning.

Results 12 comments of


                                            Grey4sh

[Bug]: deepseek-coder-v2-lite-instruct; Exception in worker VllmWorkerProcess while processing method initialize_cache: [Errno 2] No such file or directory: '/root/.triton/cache/de758c429c9ff1f18930bbd9c3004506/fused_moe_kernel.json.tmp.pid_1528_587007', Traceback (most recent call last):

I encounterd the same problem when inference DeepSeekCoder-V2 on 8 A100s with the latest vLLM docker.

[Bug]: deepseek-coder-v2-lite-instruct; Exception in worker VllmWorkerProcess while processing method initialize_cache: [Errno 2] No such file or directory: '/root/.triton/cache/de758c429c9ff1f18930bbd9c3004506/fused_moe_kernel.json.tmp.pid_1528_587007', Traceback (most recent call last):

> Maybe use triton==2.2.0. For me, it solved this problem. It works for me.

‹
1
2