TurboTransformers icon indicating copy to clipboard operation
TurboTransformers copied to clipboard

Refactor MultiheadAttention and other Layers

Open feifeibear opened this issue 5 years ago • 0 comments

Now the logic inside MultiheadAttention Layer is too complex for development. Moreover, some bugs exist in intermediate management. It is the first priority to rewrite these codes to make others easily understand what Turbo is doing.

feifeibear avatar Jul 22 '20 09:07 feifeibear