magicoder icon indicating copy to clipboard operation
magicoder copied to clipboard
verified publisher icon ise-uiuc

Code for the evaluations on APPS.

Open wyt2000 opened this issue 1 year ago • 0 comments

Hello! It is noticed that there are some new experiments for APPS benchmark in Appendix C.1 of the updated paper and MagicoderS-DS outperforms all other models. I wonder if you could provide the evaluation code for reproduction? Thanks a lot!

wyt2000 avatar Jun 12 '24 11:06 wyt2000