agent-lightning
agent-lightning copied to clipboard
I find agent lightning only use 1 actor during rollout, can we launch multiple actors?
Agent rollout takes a long time, can we create multiple actor instances to accelerate rollout. Currently I have to set TP = [number of GPUs] to use all gpus during rollout
Multiple actor instances can be set via n_workers = X in trainer.
Multiple actor instances can be set via
n_workers = Xin trainer.
I mean the number of vLLM instances instead of rollout workers.
I think this can be done via verl standard config. Reach out if you have further questions.
We might need an example for this.