Akshath
Akshath
I would like to complete this. Can this be assigned to me?
@Chitresh-code, I've created a PR. Please review it and mark it under 'hacktoberfest-accepted'
hey @NathanHB, was wondering if i can get some input on how to work on this. would love some pointers to get started on :)
hi @NathanHB! i was browsing through the repo's open issues and stumbled across this issue. can i get some more information on the issue? upon reading the links you sent...
i see! if it's fine, i can work on this and drop an implementation approach in a few hours and tag you so you can review it!
## Ideation So upon loading the dataset, I noticed that there are 50,000 entries per example, so for an initial effort, it might be better to truncate the dataset to...
can i look into this, if it's free to take up? @NathanHB
so right now it's fine if this is implemented with just the `inspect-ai` backend, yes? like how we integrate the benchmark as a task @lewtun can you please verify that...
cc: @NathanHB
i ran the benchmark on HF Inference's `gpt-4o` but a lot of the results I am seeing are quite poor. is this expected or something wrong with the prompting that...