Tecorigin

icon indicating a website link http://tecorigin.com/

icon location Where There is Computation， There is Tecorigin.

Results 1 comments of Tecorigin

[rollout] feat: add vllm pipeline parallel support for zmq executor

I hit this error when running with: vlllm 0.9.2 rollout_mode="async" VLLM_USE_V1=1 return_raw_chat=True pp>1 when step3 or step4， [rank1]:[E903 10:49:42.073383441 ProcessGroupNCCL.cpp:1896] [PG ID 5 PG GUID 15 Rank 0] Process group...