irishev

Hi! I'm experiencing the same issue and have found no performance difference between randomly initialized models and pre-trained checkpoints. So, one suspicion is there might be some problems in the...