Ola Piktus

Great, thanks @lhoestq the workaround works! I think it would be intuitive to have the support directly in `datasets` but it makes sense to wait given that the workaround exists...

Can you share code pointers for caching in `datasets`?

Cool I'd be happy to take a look in the next week or two

Hey @cakiki are you still interested in working on this? I'm thinking about IR metrics in the context of building the retriever for ROOTS - I want a simple way...

ICT - Inverse Close Task, e.g. as defined here https://arxiv.org/pdf/1906.00300.pdf Yes I think what would be more easy for my use-case would be things like Recall / Precision @ n...

@cakiki was mentioning there's a blocker on this, Chris would you be able to share the details here?