Sudhakar Singh
Sudhakar Singh
This helps me connect the dots, thanks! (I was trying to connect this `causal_conv1d` action with Attention mechanism in "Attention Expressivity" section D.2 in [H3 paper](https://arxiv.org/pdf/2212.14052.pdf))
I think it also has to do with `causal_conv1d` because attention mechanism helps in mixing across the sequence dimension which helps attention accomplish tasks like "associative_recall" and "induction_heads". Authors of...
Also, this test was never run in the CI, so we should enable that as well by adding the call to this test in `qa/L0_pytorch_unittest/test.sh` file
/te-ci pytorch
@timmoon10 could you please take a look at how the test has been modified now?
@pggPL, could you revert back files' permissions?
/te-ci pytorch
@pggPL I think your last commit doesn't have a signoff and so the DCO cribs. Could you fix that?
/te-ci pytorch
/te-ci pytorch