Oscar Skean

[Q] Using WandB Sweep + SLURM + Pytorch Lightning DDP + Multiple GPUs

10

I'm trying to register SLURM nodes as agents for sweeps. I'm using Pytorch Lightning with DDP and multiple GPUs. Following the recommendations from Pytorch Lightning ([here](https://lightning.ai/docs/pytorch/stable/clouds/cluster_advanced.html)), my SLURM sbatch script...

FroSSL Implementation

2

Implementation of FroSSL from https://arxiv.org/pdf/2310.02903 I am currently training a ResNet-18 on ImageNet100 to make sure everything is working properly

Ideas for New Features

4

Hello! I'm a big fan of this library and have been using it in my research for over a year now. At this point, I have a fork with several...