(Henry) Hung Le

Common Crawl error code 503/ 502

3

Hi, Thank you for releasing the codes for data extraction. I am extracting the data based on your scripts and I noted some errors in the log file. Most of...

False refusal detection in CyberSecEval

1

Hi, Thanks for releasing the full details of the dataset and evaluation. However, I found that in the Mitre test split, the evaluation contains the following naive refusal check, leading...

Hi, Thank you for the great work! I have 2 questions about the computation of the pass@k metric after applying filtering on the APPS benchmark. 1. Will the `total` array...

Questions on creating instruction data

1

Thanks for the great work! I have a few questions regarding data creation of xP3 after following the guide [here](https://github.com/bigscience-workshop/xmtf#create-xp3) to create instruction data on the `code` language subset. 1....