nlper27149

rewords calculate by 1st batch and then multiply 2nd batch?

header is {'Content-Type': 'audio/wav; rate=16000', 'Content-Length': 2373710} Request time cost 4.650378 {"err_msg":"invalid audio length","err_no":3314,"sn":"908218475891592216238"} length是2373710 大于 4 但是仍然报了3314，整个音频29秒

have you any plan to realeas pretraining code with horovod.

1

i try to modify origin bert code with horovod using multi-gpus .but cant get same result as one_gpu . if set train_set=1000,2gpus will fininsh at globel step at 500.and eval...