distilabel
distilabel copied to clipboard
[FEATURE] Preference task support for multi-turn dialogues
Our current preference pipelines work with the assumption of single-turn (instruction) datasets.
To generate high-quality data preferences we need to support multi-turn data.