coedit icon indicating copy to clipboard operation
coedit copied to clipboard

Request for Evaluation Code and Metrics

Open adamlin120 opened this issue 5 months ago • 0 comments

Hello,

I recently read your interesting paper. The results look very promising and I'm excited to try out the COEDIT models.

In Section 4 "Experimental Setup" of the paper, several evaluation datasets and metrics are described. However, I didn't see the code for computing these metrics or the full evaluation pipeline provided in the linked GitHub repo.

Would it be possible for you to please open-source the code you used to evaluate the models and compute the reported metrics? Having access to the exact evaluation scripts and metric implementations would help ensure reproducibility and make it easier for others to benchmark against COEDIT and validate the results.

Thanks!

adamlin120 avatar Mar 25 '24 02:03 adamlin120