layer_norm_expressivity_role icon indicating copy to clipboard operation
layer_norm_expressivity_role copied to clipboard

Published 20 hours ago • verified publisher icon tech-srl
→

Metadata

Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)

Results 1 layer_norm_expressivity_role issues
Sort by recently updated
recently updated
newest added

The experimental results cannot be replicated. script do not work!

2 comment

when calling run_job.bash ``` majority/majority_exp.py", line 294, in run_experiment _, queries, _, keys, Q, K, _ = model(classes) ValueError: not enough values to unpack (expected 7, got 3) ``` it...

liveck avatar liveck

← Metadata

43
Stars
3
Forks
Watchers

Owner

verified publisher icon tech-srl

Metadata

Code for the paper "On the Expressivity Role of LayerNorm in Transformers' Attention" (Findings of ACL'2023)

Back