Gym
Gym copied to clipboard
Ray utils
This PR adds support for spinning up GPU Ray actors, including and especially VLLM instances, from within Gym servers.
Issue resolved:
- https://github.com/NVIDIA-NeMo/Gym/issues/282
PR merge dependency:
- https://github.com/NVIDIA-NeMo/Gym/pull/317
Related:
- https://github.com/NVIDIA-NeMo/RL/pull/1613
- https://github.com/NVIDIA-NeMo/RL/pull/1602
This pull request requires additional validation before any workflows can run on NVIDIA's runners.
Pull request vetters can view their responsibilities here.
Contributors can view more details about this message here.
@pjin-nvidia can you add a description for the scope of PR and/or link an issue?