Alex Spies

icon indicating a website link afspies.com icon indicating an email [email protected]

icon company @ImperialCollegeLondon icon location London, UK icon location Mechanistic Interpretability & Neurosymbolic AI | PhD Candidate in CS @ImperialCollegeLondon | Research Lead @understanding-search |

Results 2 issues of Alex Spies

[Bug Report] `load_and_process_state_dict` handles LayerNorm folding poorly

4 comment

**Describe the bug** If one attempts to load the `state_dict` of a model which was saved without folded `LayerNorms` (i.e. without `LayerNormPre`) calling `load_and_process_state_dict(state_dict, fold_ln=True)` fails due to the strict...

help wanted

Fix typo on estimated_stepping_batches property in trainer.py

## Typo fix ---- 📚 Documentation preview 📚: https://pytorch-lightning--19847.org.readthedocs.build/en/19847/

pl