WBL issues

Repositories
Issues
Comments

Results 2 issues of

WBL

I'm curious why you set segment_embedding's first dimension to 3.

First of all, thanks for your kind offer. Why did you set segment_embedding's first dimension to 3 ?? This is on path [FastBERT/uer/layers/embeddings.py] (line 18) Is this part flexible depending...

I'm curious about the reason for making self-attention for each classifier layer.

First of all, thanks for your kind offer. What do you think is the reason for self-attention for each classifier layer? The paper also says that it does self-attention in...