Can we fine-tuning the Text-to-Code Retrieval task?

[pdhung3012]

Hello I wonder if we can finetune the text-to-code retrieval task for Text-to-Code Retrieval like UniXcoder at here. I have run the zero-shot code retrieval for Javascript. It shows that the best accuracy I can get for code retrieval is 70.2%, which is lower than the fine-tuned CodeT5+ at 71.3% (reported in CodeT5+ paper at here. So I want to check if I can increase the zero-shot result by fine-tuning.

Thank you

[yuewang-cuhk]

Yes, you can definitely finetune on labeled datasets using contrastive loss (or combined with the matching loss) to further boost the retrieval performance. We plan to release the finetuning scripts in the future if there are many asks for this.

[gzt4se]

Yes, you can definitely finetune on labeled datasets using contrastive loss (or combined with the matching loss) to further boost the retrieval performance. We plan to release the finetuning scripts in the future if there are many asks for this.

I would like to ask if there are now open-source finetune scripts to share for Text-to-Code Retrieval using codet5+, thanks a lot!