Guanghao Zhou

Results 1 issues of Guanghao Zhou

tokenizer.vocab_size=12800, why does token id = 12800 appear? Shouldn't token id < tokenizer.vocab_size? ![1](https://github.com/user-attachments/assets/b31ecaf8-8f9f-4af2-89c0-8aa7cddb1eff) ![2](https://github.com/user-attachments/assets/d05345aa-1306-4000-ac4b-fd48fb1e97f2)

question