James Dao issues

Repositories
Issues
Comments

Results 2 issues of


                                            James Dao

[Bug Report] Attention masking is not used by model forward methods

![image](https://github.com/neelnanda-io/TransformerLens/assets/30713160/d9011129-901d-4860-b3d1-778509d800ba)

[Bug Report] `ActivationCache.apply_ln_to_stack` silently returns the resid stack for unsupported normalization types

https://github.com/neelnanda-io/TransformerLens/blob/ce82675a8e89b6d5e6229a89620c843c794f3b04/transformer_lens/ActivationCache.py#L991-L993 `Meta and the RMSnorm gang has entered the chat`