opt_einsum icon indicating copy to clipboard operation
opt_einsum copied to clipboard
verified publisher icon dgasmith

Multiple GPUs

Open alex-orca opened this issue 2 years ago • 1 comments

Hi, I am using this package (via quimb) with pytorch as a backend for large contractions. I am able to run on 1 GPU using pytorch, but is there anyway to use multiple GPUs at once for distributed calculation of contractions? I am happy to change back end if needed! Thanks

alex-orca avatar Apr 20 '23 09:04 alex-orca

Hi @alex-orca, automatic distributed contraction is quite a difficult task and I'm not aware of any purely 'just switch backend' based method, though would be happy to hear if anyone knows of one! I know there is work being done on it.

One option, which hasn't made it into opt_einsum yet, is to use 'slicing'. cotengra supports automatic 'slicing', and there is a MPI style example here. The overhead can be quite dependent on the actual contraction geometry, bear in mind.

jcmgray avatar Apr 24 '23 03:04 jcmgray

I'm closing this as out of scope. We're here to optimize the path and nothing more echoing @jcmgray's answer.

dgasmith avatar May 14 '24 23:05 dgasmith