Cody Yu
Results
22
issues of
Cody Yu
The use of `current_platform.get_device_name()` in `arg_utils.py` is too early and is not compatible with Ray, because Ray Serve may import vLLM at the main actor to use some of its...
ready
v1
`signal.signal` can only be used in the main thread, or it will throw an exception otherwise. In the Ray Serve use cases, however, we launch an engine in a separate...
ready
v1