Pengcheng He

icon company Microsoft icon location Redmond

Results 5 comments of Pengcheng He

RuntimeError: Index tensor must have the same number of dimensions as input tensor

Never hit such kind of error before. Can you share how did you get this? Did you try our example scripts ?

RuntimeError: Index tensor must have the same number of dimensions as input tensor

In our current version, we only support key and query having the same length.

This model for MLM is waste of time, why did you even made it if it cannot be used?

Our code for pre-training V3 updated.

Sharing DeBERTa-v3 discriminator and generator with task-specific heads?

Thanks for your interesting to our work. We updated our code with pre-training/continuous training of DeBERTaV3. Please check the document for details.

Where is the Gradient-Disentangled Embedding Sharing(GDES) part in the code?

updated.