composer icon indicating copy to clipboard operation
composer copied to clipboard

Published 20 hours ago • verified publisher icon mosaicml

Remove unnecessary pad token

Open vigneshwaran opened this issue 2 years ago • 0 comments
trafficstars

What does this PR do?

Instead of padding till max_seq_len, use the maximum length of the batch.

I have provided a simple and concise solution.

What issue(s) does this change relate to?

  • Fixes #2421

vigneshwaran avatar Aug 12 '23 07:08 vigneshwaran