human-eval icon indicating copy to clipboard operation
human-eval copied to clipboard

Will this be helpful for people reading the paper ?

Open jalotra opened this issue 4 years ago • 2 comments

I was reading your paper. And was interested in seeing what the test data looks like. But you have given it in .jsonl format which is okay if you are doing a careful analysis of the test data.

But for quick readers parsing the test data requires willingness and they might not want to do it.

So I parsed the data.jsonl into Human Readable Prompt and Canoncial Sections : https://gist.github.com/jalotra/f4d119e8108fcd44b932103d73140381.

Will this add value to this repo if we can add this for a quick read ?

jalotra avatar Jul 09 '21 06:07 jalotra

I agree, two or three example datapoints in the README for this repo would be really helpful.

jack-jjm avatar Jan 26 '23 11:01 jack-jjm

Great sharing!

HenryHZY avatar Mar 16 '23 08:03 HenryHZY