Cannot reproduce softmatch result on ag_news dataset

[Mezbaur-Rahman]

I am running the following code:

python3 train.py --c config/usb_nlp/softmatch/softmatch_ag_news_40_0.yaml

But the accuracy I get is 0.8447368421 i.e error rate of 0.15 which is higher than what is reported in the result section (11.9±0.27). I am running the code with the exact config file from the repo. I also tried with different seeds but no improvement. What can be the issue here?