Huayang Li

Gradient overflow when running the example of Adaptive Input Representations

9

## ❓ Questions and Help #### What is your question? Got `inf` loss and gradient overflow when running the [code example of adaptive input representation](https://github.com/pytorch/fairseq/blob/main/examples/language_model/README.adaptive_inputs.md) with `--fp16`. I am trying...