fibber icon indicating copy to clipboard operation
fibber copied to clipboard

Published 20 hours ago • verified publisher icon DAI-Lab

Change Dataset to use TokenizerFast.

Open leix28 opened this issue 4 years ago • 0 comments

Current Dataset manually constructs the input tensor, masks, etc. We can make it more clear by using transformers.BertTokenizerFast

leix28 avatar Feb 19 '21 22:02 leix28