Siddharth Varia

icon indicating an email [email protected]

icon location Seattle, WA icon location Graduate student at Columbia University

Results 1 issues of Siddharth Varia

CPU offload when not using offload deepspeed config file

3 comment

Hi Philipp, thanks for your awesome blog on training Flan T5 XXL. I am playing around with it and doing just zero-shot inference using ds_flan_t5_z3_config_bf16.json deepspeed config file. I believe...