Ashh-Z

I used Transformers==4.17 and did not face further issues

> Alright I think the problem is simply that the author of the issue and myself actually use multilabel models :) So of course the segmentation threshold is needed. >...

Have you tried changing your pytorch lightning version ? I had faced the same issue on a different repository a while back, and changing the lightning version helped.