In training model, where mention position is indicated?

[izuna385]

Thanks for uploading codes for Zero-shot EL, I'm very interested in this work. Currently I'm reading codes but can't find where mention position is indicated. (In the original paper, written as

[Ms], [Me] are special tokens to tag the mention.

)

https://github.com/lajanugen/zeshel/blob/master/create_training_data.py#L351 indicates [CLS] and [SEP] for concatenating mention-contexts and candidate documents. I can't find codes for inverting [Ms] and [Me].

If you'd know something about this, I'd appreciate it much. Thanks.