optimum-intel icon indicating copy to clipboard operation
optimum-intel copied to clipboard

[OpenVINO] Set Left Padding For Text Generation Task

Open apaniukov opened this issue 7 months ago • 1 comments

What does this PR do?

Set the left padding side during tokenizer conversion for text generation tasks.

Fixes # (issue)

Before submitting

  • [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • [ ] Did you make sure to update the documentation with your changes?
  • [x] Did you write any new necessary tests?

apaniukov avatar Jul 25 '24 09:07 apaniukov