I'm curious why you set segment_embedding's first dimension to 3.

[wonbeeny]

First of all, thanks for your kind offer.

Why did you set segment_embedding's first dimension to 3 ??

This is on path [FastBERT/uer/layers/embeddings.py] (line 18)

Is this part flexible depending on the model architecture? The paper does not have this content, so I asked a question.

[Domifance]

You look at the code, It has nothing to do with the structure of the model. It's just a convenient to model implementation, in fact,segment_embedding first dimension in pre_trained model is all zeros.