Cannot reproduce results for RobertaGen on SVAMP

[qfkkwgd]

Hi,

Thanks for your great work.

I am trying to reproduce the results for RobertaGen on SVAMP.

This is my command

python run_mwptoolkit.py
--model=RobertaGen --dataset=mawps_asdiv-a_svamp --task_type=single_equation --equation_fix=prefix --k_fold=None --test_step=5 --gpu_id=1

In your paper, the performance of RoBERTaGen on SVAMP is 30.3%. But my reproduced result is only 23.4%. Could you share with me about why this happens?

Thanks again for your work!