llm-foundry icon indicating copy to clipboard operation
llm-foundry copied to clipboard

Published 20 hours ago • verified publisher icon mosaicml

Any example script to run multi-node training for slurm?

Open wavy-jung opened this issue 1 year ago • 7 comments

Hi, I was trying to run multi-node training on slurm nodes but I have no idea how to configure composer arguments and commands. Is there any example script to run training on slurm nodes with composer?

wavy-jung avatar Jul 20 '24 10:07 wavy-jung