VAR
VAR copied to clipboard
there are many ... in your script ,please provide complete instruction
torchrun --nproc_per_node=8 --nnodes=... --node_rank=... --master_addr=... --master_port=... train.py
--depth=16 --bs=768 --ep=200 --fp16=1 --alng=1e-3 --wpe=0.1 fail to run it please provide complete instruction