FlagEmbedding icon indicating copy to clipboard operation
FlagEmbedding copied to clipboard
verified publisher icon FlagOpen

fixed "You're using a XLMRobertaTokenizerFast tokenizer"

Open devbutlazy opened this issue 2 months ago • 0 comments

switched tokenizer.pad to call method for better performance and error avoidance

devbutlazy avatar Nov 12 '25 16:11 devbutlazy