Morris Xu

icon indicating an email [email protected]

icon location Singapore icon location DL/ML Research and Development

Results 1 comments of Morris Xu

torch.max(attention, dim=-1, keepdim=True)[0].expand_as(attention) - attention

I just deleted this line and do my own experiments with no anomaly spotted.