Fartash Faghri issues

Repositories
Issues
Comments

Results 2 issues of


                                            Fartash Faghri

config/optimState passed to sgd needs to be stored in a train loop

Hi, I think the way optim.sgd is called in the examples has issues with momentum. `config` passed to optim.sgd(_,_,config,state) should be kept from one training iteration to another when no...

Memory leak at the end of an epoch of training with OpenCLIP on a WebDataset

I observe a potential memory leak when training with OpenCLIP on a WebDataset. The memory usage is flat during an epoch and then increases at the beginning of the next...

bug