Anna S.

icon company University of Waterloo icon location Montreal icon location Statistics & CS Student from McGill University

Results 1 issues of Anna S.

Translation model Cross Attention problem, inconsistent with paper !

1 comment

When I'm inspecting the cross-attention layers from the pretrained transformer translation model (MarianMT model), It is very strange that the cross attention from layer 0 and 1 provide best alignment...