stable-diffusion icon indicating copy to clipboard operation
stable-diffusion copied to clipboard

Published 20 hours ago • verified publisher icon CompVis

OverflowError: cannot fit 'int' into an index-sized integer

Open zws98 opened this issue 3 weeks ago • 0 comments

when I use the tokenizer, the error occurs: Info:File "/home/z/anaconda3/envs/t2v/lib/python3.9/site-packages/transformers/tokenization_utils_base.py", line 3737, in _pad encoded_inputs["attention_mask"] = encoded_inputs["attention_mask"] + [0] * difference !:OverflowError: cannot fit 'int' into an index-sized integer

I check the value of "difference" = 1000000000000000019884624838647

zws98 avatar Jun 26 '24 07:06 zws98