transformers icon indicating copy to clipboard operation
transformers copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Generate: add warning when left padding should be used

Open gante opened this issue 1 year ago • 1 comments

What does this PR do?

As the title describes: add a warning when left padding should be used. Incorrect use of right padding is detected when:

  1. the model is decoder-only;
  2. there is a padding token in the last member of the sequence.

gante avatar Sep 16 '22 12:09 gante

The documentation is not available anymore as the PR was closed or merged.

HuggingFaceDocBuilderDev avatar Sep 16 '22 12:09 HuggingFaceDocBuilderDev