rasdani

I can convert the redis setup from this [docker-compose.yml](https://github.com/LAION-AI/Open-Assistant/pull/187/files#diff-3fde9d1a396e140fefc7676e1bd237d67b6864552b6f45af1ebcc27bcd0bb6e9) to an ansible build. Could you assign me please, in case no one is on it already?

Created a PR #405

ran `pre-commit` before adding the `README.md` and forgot to run again

I recall vaguely the config file beeing mounted from the working directory into the docker container. If lines 28 and 29 in the playbook work like they would in a...

Ah, I see. I tested this by spinning up an ubuntu container on my local machine an let ansible ssh into it (don't recommend this, annoying). When we provide ansible...

figured it out :)

you're welcome, see you on youtube ;)

I just noticed that `self._dataset` is an `IterableDataset`, therefore `.select()` is not supported. Than probably some version of the later implementation?

I will take a stab at a Bengali benchmark together with a colleague of mine 👍

I did a test run and generated queries over the GermanRAG dataset with our internal synthetic data pipeline. You can find the source dataset and the resulting dataset here: https://huggingface.co/datasets/rasdani/germanrag-positives...