Zhoujiecheng

icon indicating a website link https://www.ustc.edu.cn/

icon company USTC icon location China icon location A PhD student at the University of Science and Technology of China (USTC)

Results 2 comments of Zhoujiecheng

Unexpected OOM and the process seems to be forked

Set free_cache_engine = True may help

Bug when using vllm async rollout

> How did you use the vllm async rollout? Could you post a test script? I only made some modifications to verl/recipe/dapo/test_dapo_7b.sh, setting actor_rollout_ref.rollout.mode=async. And change NNODE to 1 for...