Mootez Saad

icon location Halifax, Nova Scotia, Canada. icon location https://web.cs.dal.ca/~msaad/

Results 1 issues of Mootez Saad

Truncation of sequences that are beyond the model's maximum length

2 comment

Hi, First, I would like to thank you for this library :-) I'm really enjoying it. I tried to tokenize a sequence with around 4K tokens and then fed it...

type/bug
type/feature
feat/tokenization