distilabel icon indicating copy to clipboard operation
distilabel copied to clipboard

[FEATURE] Preference task support for multi-turn dialogues

Open dvsrepo opened this issue 1 year ago • 0 comments

Our current preference pipelines work with the assumption of single-turn (instruction) datasets.

To generate high-quality data preferences we need to support multi-turn data.

dvsrepo avatar Nov 29 '23 15:11 dvsrepo