Necofish
Necofish
> Hi, I built the base image from the deepseek_ep branch, and then used Dockerfile.deepep to build the deepep image, but when starting sglang, I get the following error. How...
During my request to the 'disaggregation.mini_lb' proxy service, an error occurred: the decode instance was unable to acquire the prefill instance's TP size, generating the following error message: ``` [2025-05-07...
I encountered the same issue while trying to deploy deepseek-r1 using trtllm-serve on two nodes with 16 GPUs (H20).