ChenyuWang1022 issues

Repositories
Issues
Comments

Results 1 issues of


                                            ChenyuWang1022

vllm generate speed difference under sync and async mode

We tested the performance of model training in async and sync modes. and we found that the rollout performance in async mode was significantly lower than in sync mode, (especially...