Terry Yue Zhuo

Sure! My email address is `[email protected]`.

Hi, I'm working (slowly) on a new version on the [dev](https://github.com/terryyz/llm-code-eval/tree/dev) branch, which supports the open model inference. I previously tested with LLaMA only and haven't had time to compute...

Hi @gvijqb, No problem! Please let me know if you'd like to collaborate on this project and beyond :) Cheers, Terry

Not sure if MonsterAPI may support some computational resources. I'm a bit short of good GPUs these days 😞

Hi @littlepopy, the details were discussed in Appendix B.2 in the [paper](https://arxiv.org/pdf/2302.05527.pdf), where the data was collected from [HumanEval-X](https://huggingface.co/datasets/THUDM/humaneval-x). Besides, you may also find [our paper](https://arxiv.org/abs/2304.14317) useful. [This folder](https://github.com/terryyz/llm-code-eval/tree/main/data) may...