Conglong Li

icon indicating a website link https://conglongli.github.io/ icon indicating an email [email protected]

icon company @google-deepmind icon location Tokyo, Japan icon location Senior Research Scientist at Google DeepMind Japan office; ex-Microsoft DeepSpeed member; CMU Ph.D.

Results 1 issues of Conglong Li

Data efficiency library update

1. Update blog/tutorial based on new results on BERT pretrain/GPT-2 finetune (corresponding update to examples: https://github.com/microsoft/DeepSpeedExamples/pull/238 and https://github.com/microsoft/Megatron-DeepSpeed/pull/113). 2. Fix the case when user provides a collate function. 3. Fix...