Amy Lu comments

Repositories
Issues
Comments

Results 4 comments of


                                            Amy Lu

Using DDP with WebDataset in pytorch lightning

Hi! New to the webdataset library -- could someone explain why `with_epoch` and `unbatched` is necessary for DDP training? > @laolongboy > > > Same question. How to set the...

Upgrade DeepSpeed version?

Bumping this up: I'm running into this issue as well, and downgrading back to deepspeed==0.5.10 as in the environment.yml no longer works with torch==2.0.0 (see [this issue](https://github.com/microsoft/DeepSpeed/issues/2845)). Applying [this commit](https://github.com/EvanKomp/openfold/commit/d40a4eb39b20b3b5cdcea9cef7d0904198b6b8bf)...

Example for finding features with epistatic effects with scikit-mdr

The test code worked for me and did what I had wanted to do. Thanks!

[v2] Attention Masking

> Attention mask isn't supported (either in v1 or v2). I might implement it at some point but there are other priorities now. Seems like the FlashAttention class does [take...