Alvaro Bartolome

### System Info - `transformers` version: 4.40.2 - Platform: Linux-5.15.0-87-generic-x86_64-with-glibc2.35 - Python version: 3.10.12 - Huggingface_hub version: 0.23.0 - Safetensors version: 0.4.3 - Accelerate version: 0.30.0 - Accelerate config: not...

[PROPOSAL] Allow an arbitrary number of rankings for `RankingQuestion`

2

**Describe your proposal** As of now, the `RankingQuestion` doesn't let you define the number of ranks you want to use, as that just matches the amount of options you define...

## Description I've created this issue so as to update the repository since there are some things I've updated myself in other forks from this repository, so it would be...

Add `pip-tools` to lock dependencies

1

https://github.com/jazzband/pip-tools

## Description Since we're reproducing some papers with the `distilabel` task created to do so, we recently created `PrometheusEval`, but no tutorial has been uploaded yet, only https://x.com/alvarobartt/status/1788152893461123105 was posted....

## Description In `distilabel` v1.0.0 we included the task `TextGeneration` and at the last moment we decided to include support for an already formatted chat like object i.e. a list...

Add `scripts/run_kto.py`

1

## Description As briefly discussed with @lewtun this morning, this PR adds the `scripts/run_kto.py` script to fine-tune LLMs using the `trl.KTOTrainer` from the `alignment-handbook`. The script should work as is,...

## Description Since recently Mistral marked their repository at https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2 as a gated repository, I'm afraid that the account using the `HF_TOKEN` set as a secret for the CI will...