Mozhi Zhang

icon indicating a website link http://www.mozhi.umiacs.io/

icon company University of Maryland icon location PhD Candidate at University of Maryland

Results 1 issues of Mozhi Zhang

Cannot train Seeker with batch size > 1

11 comment

**Bug description** It seems that Seeker training command does not support batch size > 1. I ran into a FSDP error when training Seeker-400M with `-bs 2`. **Reproduction steps** ```...

donotreap