Yiding-Lu

+1, looking forward to the author’s improvement @hiyouga

> No, I switched to [LLaVA](https://github.com/haotian-liu/LLaVA) where I didn't encounter it. However, I hope they fix it What did you mean by "switched to"? Install the training package of LLaVA?

> I have set `export NCCL_P2P_DISABLE=1 export NCCL_IB_DISABLE=1 export NCCL_SOCKET_IFNAME=eth0 export NCCL_SHM_DISABLE=1 ` It temporarily works for me @FSet89 Not work for me.

> Good catch! Can you add a test case under https://github.com/sgl-project/sglang/blob/main/test/srt/test_vision_openai_server.py? Can I add a `.jsonl` file in this directory? The batch request needs to upload an input file, like...