human-eval
human-eval copied to clipboard
Will this be helpful for people reading the paper ?
I was reading your paper. And was interested in seeing what the test data looks like.
But you have given it in .jsonl format which is okay if you are doing a careful analysis of the test data.
But for quick readers parsing the test data requires willingness and they might not want to do it.
So I parsed the data.jsonl into Human Readable Prompt and Canoncial Sections : https://gist.github.com/jalotra/f4d119e8108fcd44b932103d73140381.
Will this add value to this repo if we can add this for a quick read ?
I agree, two or three example datapoints in the README for this repo would be really helpful.
Great sharing!