schlabrendorff

For me the bottleneck was that by default in my SLURM cluster a task only gets 1 CPU core. When not using srun, python failed to use multiple GPUs. But...

My slurm cluster runs on `slurm 23.02.6` that might explain the difference! I will try to experiment with the `--exclusive` flag, but might not get the chance for that soon.

I think the Request Defaults could might also come into play in my scenario, since my cluster documentation specifies. > Request Defaults: > Unless specified, your jobs will run with...

They were listed in my university's cluster documentation page. I guess besides trying to read your `/etc/slurm/slurm.conf` you can maybe submit an empty job with absolutely no resources requested and...