Hard negative mining for wikipedia pretraining

[WenzhengZhang]

Hi, did you use hard negative mining in addtion to in batch training when you pretrained the model on wikipedia? Will it be too time consuming? Thanks!

[kaisugi]

hard negatives seems to be unimplemented (#31 ), though you can find one from this unofficial implementation (note that this is for "Zero-shot Entity Linking")