Gong Shufan

It looks like ucx is not installed or configured correctly. > [1747215696.528332] [b3ab5fdd703b:1615 :0] ucp_context.c:1268 UCX WARN transports 'cuda_ipc','cuda_copy' are not available, please use one or more of: mm, posix,...

@tensorflowt Please try to import this: https://drive.google.com/file/d/19BVc7RLSCt0Z-IStwSdN3p47bxY5fsZs/view?usp=sharing. The vllm and other repos are inside the `/root`. Import the docker image ``` sudo docker import lmcache.tar.gz vllm:lmcache ``` I start the...

> I want to confirm whether the command to enter the container is to run vllm serve directly? Because I can't see it here, I'm not sure whether I just...

I am using vllm version 0.8.5, and at this commit f25e0d1125f873201ae880b50df46a9e3d29f3ba.

``` # pip list Package Version Editable project location ---------------------------------------- ----------------------------------- ------------------------- aiofiles 24.1.0 aiohappyeyeballs 2.6.1 aiohttp 3.11.18 aiosignal 1.3.2 airportsdata 20250224 annotated-types 0.7.0 anyio 4.9.0 appdirs 1.4.4 astor 0.8.1...

It is strange :( The lmcache.tar.gz looks good: ``` shufan@gpusvr01:/nfs/home/shufan/tmp$ md5sum lmcache.tar.gz cdbd0bd5ea1361c75de6218b30b4f077 lmcache.tar.gz shufan@gpusvr01:/nfs/home/shufan/tmp$ sudo md5sum lmcache.tar 5a10b32fd04af8f8281793c6ee1ba2bb lmcache.tar ``` This lmcache.tar is from `tar -zxvf lmcache.tar.gzz`. And it's...

The same for me