Can't reproduce codeformer

[Florenyci]

When I try to fine-tune codeformer from stage1-stage3 on my own dataset, I found the fine-tuned model is always worse than pre-trained model, any advice? @sczhou