Is that safe to use the <|extra_{k}|> special token?

[xwk]

起始日期 | Start Date

No response

实现PR | Implementation PR

No response

相关Issues | Reference Issues

No response

摘要 | Summary

Thanks for the amazing work.

I was trying to finetune QWen-VL for some application where a new special token is required. I noticed there are already some extra special tokens defined in the tokenizer's vocabulary like <|extra_{i}|>, where i is from 0 to 204. Can I use some of these tokens instead of adding a new special token to the vocabulary.

基本示例 | Basic Example

N/A

缺陷 | Drawbacks

N/A

未解决问题 | Unresolved questions

No response