Fix error text in BCO and KTO tokenizer function.

Open PhilipMay opened this issue 1 year ago • 1 comments

The error text is saying:

"Prompt input ids and answer input ids should have the same length."

This is very misleading. The code does not compare prompt and answer in this case.

Oct 26 '24 19:10 PhilipMay

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Oct 26 '24 20:10 HuggingFaceDocBuilderDev

I don't think the CI problems have anything to do with the changes in this PR...

Oct 27 '24 17:10 PhilipMay

Thanks @PhilipMay! Do you mind updating your branch? I don't have the writing rights on your branch.

Nov 05 '24 18:11 qgallouedec