Artem Liakhov

icon location Student of Applied Mathematics program and big AI enthusiast

Results 1 issues of Artem Liakhov

Total number of training steps during KG pretraining

Hi! Great work and thanks a lot for open-sourcing! In `stage2_kg_pretrain.yaml` there is a `batch_per_epoch` parameter. As far as I understand from reading of the code, it is responsible for...