About Training Time And Gpu

[xswings]

Could you please telling me how long did you take in pre-training time，stage1 and stage2 respectively？ And what gpu and how many did you use？I need to pre-train with my own datasets，so I have to evaluate time consuming.

[penghao-wu]

We use 4 V100 for training. Sorry that I can't remember the exact training time, perhaps 2-3 days per stage.