Multi GPU Paralellism

[martindellavecchia]

I have a 2 GPU system, a 3060 (12gb VRAM) and a 3070ti (8GB). I've read torch supports paralellism that can split large models into both GPUs, it'd be great to have something like that to run big models for hich accuracy on multiple GPUs.