thqq479

> > [@thqq479](https://github.com/thqq479) > > > > > [@alogfans](https://github.com/alogfans) [@ShangmingCai](https://github.com/ShangmingCai) Hi, may I ask how I should proceed to further investigate this issue, or what environment you tested in? >...

export SGLANG_MOONCAKE_CUSTOM_MEM_POOL=True export MC_FORCE_MNNVL=True After setting these two environment variables, the service will OOM when starting up, and it seems that the fragmentation is quite severe? @ShangmingCai @alogfans

> > export SGLANG_MOONCAKE_CUSTOM_MEM_POOL=True export MC_FORCE_MNNVL=True After setting these two environment variables, the service will OOM when starting up, and it seems that the fragmentation is quite severe? [@ShangmingCai](https://github.com/ShangmingCai) [@alogfans](https://github.com/alogfans)...

> The NVLink transport currently available in multi-node NVLink clusters only. For regular NVLinks, you can use the RDMA transport. What are multi-node NVLink clusters? Can't the transmission be done...