vllm icon indicating copy to clipboard operation
vllm copied to clipboard

Published 20 hours ago • verified publisher icon vllm-project

[Bugfix] Fix ray instance detect issue

Open yma11 opened this issue 4 months ago • 1 comments

Fix ray instance detect so that will first try connecting to latest launched instance and if not, create a new one with num_gpus=parallel_config.world_size.

yma11 avatar Oct 17 '24 00:10 yma11