dgl icon indicating copy to clipboard operation
dgl copied to clipboard

Create documentation on estimate hardware requirement for training GNN models on large graphs.

Open jimjlu99 opened this issue 2 years ago • 3 comments

📚 Documentation

jimjlu99 avatar Aug 09 '22 20:08 jimjlu99

Da already have a workable script, assign to Da to post details to the issue.

frozenbugs avatar Sep 28 '22 01:09 frozenbugs

https://gist.github.com/zheng-da/ca33af9048d09553f668f95bfd13cb0e

the code shows how to calculate the memory requirement for GNN training in DistDGL.

zheng-da avatar Oct 05 '22 02:10 zheng-da

Should this script be added into the DGL repo? @zheng-da

TristonC avatar Oct 12 '22 23:10 TristonC

@TristonC I think it is too early at the moment. We are going to have a thorough review of the design of DistDGL soon due to the recent requests of reducing memory/startup overhead and supporting link prediction w/o information leakage. After that, we can have a more accurate estimation.

I will close this item. Feel free to reopen if you have further questions.

jermainewang avatar Oct 17 '22 05:10 jermainewang