Clay Mullis
Clay Mullis
> @mehdidc Hi Mehdi! I am actually busy with protein folding replication (Alphafold2), but I think @robvanvolt and @afiaka87 would definitely love to make use of the resources :) Thank...
@lucidrains I know you're busy but a quick yes or no will suffice- Does the codebase in its current form make use of multiple GPUs?
@mehdidc Just to be clear - we are quite interested. I'll be making this a high priority but can only help so much due to my lack of machine learning...
> Hey folks! So there will be no trouble to arrange access to compute resources in size of 2 compute nodes with 4x GPUs each, given that we have together...
Hm - well if you're not in desperate need of the actual sparse attention then as far as I'm concerned - turn it off the moment it gives you problems...
> @lucidrains If it's fine with you, I'd take the learning experience with DeepSpeed and try to get it running on some V100s tomorrow. Please tell me if you'd rather...
> Ah right, you also mentioned you wanted to do it, sorry! I'll see how far I can get tomorrow and stay in touch with you on the Discord, is...
@janEbert @JeniaJitsev This system is indeed complex. Could I borrow one of you for a quick tutorial on deploying dalle-pytorch with a proper dataset? I believe that would speed up...
Some of this discussion may be relevant https://github.com/lucidrains/DALLE-pytorch/issues/250
https://github.com/lucidrains/DALLE-pytorch/pull/320