agent-lightning icon indicating copy to clipboard operation
agent-lightning copied to clipboard

[WIP] Upgrade vLLM to 0.11.0

Open ultmaster opened this issue 3 months ago • 0 comments

It's not working with verl 0.5.0.

ray.exceptions.RayTaskError(ModuleNotFoundError): ray::WorkerDict.actor_rollout_init_model() (pid=10928, ip=10.1.1.104, actor_id=3b846a02a80aa8b92c91fcfb01000000, repr=<verl.single_controller.ray.base.WorkerDict object at 0x78f9a5c11e50>)
  File "/usr/lib/python3.12/concurrent/futures/_base.py", line 449, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
           ^^^^^^^^^^^^^^^^^^^^^
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/vss/_work/agent-lightning/agent-lightning/.venv/lib/python3.12/site-packages/verl/single_controller/ray/base.py", line 705, in func
    return getattr(self.worker_dict[key], name)(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/vss/_work/agent-lightning/agent-lightning/.venv/lib/python3.12/site-packages/verl/single_controller/base/decorator.py", line 514, in inner
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/vss/_work/agent-lightning/agent-lightning/.venv/lib/python3.12/site-packages/verl/workers/fsdp_workers.py", line 626, in init_model
    self.rollout, self.rollout_sharding_manager = self._build_rollout(
                                                  ^^^^^^^^^^^^^^^^^^^^
  File "/mnt/vss/_work/agent-lightning/agent-lightning/.venv/lib/python3.12/site-packages/verl/workers/fsdp_workers.py", line 1647, in _build_rollout
    rollout, rollout_sharding_manager = super()._build_rollout(trust_remote_code)
                                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/vss/_work/agent-lightning/agent-lightning/.venv/lib/python3.12/site-packages/verl/workers/fsdp_workers.py", line 481, in _build_rollout
    from verl.workers.rollout.vllm_rollout import vLLMRollout
  File "/mnt/vss/_work/agent-lightning/agent-lightning/.venv/lib/python3.12/site-packages/verl/workers/rollout/vllm_rollout/__init__.py", line 17, in <module>
    from .vllm_rollout_spmd import vLLMAsyncRollout, vLLMRollout  # noqa: F401
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/vss/_work/agent-lightning/agent-lightning/.venv/lib/python3.12/site-packages/verl/workers/rollout/vllm_rollout/vllm_rollout_spmd.py", line 50, in <module>
    from vllm.model_executor.sampling_metadata import SamplingMetadata
ModuleNotFoundError: No module named 'vllm.model_executor.sampling_metadata'

ultmaster avatar Oct 11 '25 15:10 ultmaster