Max Zvyagin

icon location Bioinformatics Scientist @ GT Molecular

Results 1 comments of Max Zvyagin

Deepspeed sharding and load from checkpoint with custom lightning module - setup() not called during checkpoint loading

Hi Akarsh, thanks for checking this out! I guess my question is partially what the reason is for calling `enable_transformers_pretrained_deepspeed_sharding(self)` in the setup() function vs in the constructor, and if...