dgl icon indicating copy to clipboard operation
dgl copied to clipboard

[DistGB] save as graphbolt graph directly after partition

Open CfromBU opened this issue 1 year ago • 31 comments
trafficstars

Simplify the graphbolt graph generation process, now we no longer need to save the DGLGraph to generate the FusedCSCSamplingGraph in partition process

CfromBU avatar Aug 13 '24 09:08 CfromBU

To trigger regression tests:

  • @dgl-bot run [instance-type] [which tests] [compare-with-branch]; For example: @dgl-bot run g4dn.4xlarge all dmlc/master or @dgl-bot run c5.9xlarge kernel,api dmlc/master

dgl-bot avatar Aug 13 '24 09:08 dgl-bot

Commit ID: 589f45c6eb7a5dde89105b710f39d8d268696c71

Build ID: 1

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot avatar Aug 13 '24 09:08 dgl-bot

Commit ID: 4fc54fd804644fa0e2053708307d1a51f5bb0fc8

Build ID: 2

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot avatar Aug 13 '24 09:08 dgl-bot

Commit ID: f051c87ea4703e2f8c2e825ddeb13db9af9626f2

Build ID: 3

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot avatar Aug 13 '24 10:08 dgl-bot

Commit ID: 087c99e2480a8977b54cf91bf13de47297e3079e

Build ID: 4

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot avatar Aug 13 '24 10:08 dgl-bot

Commit ID: 63c4de9fccdc7800ef4c3129bf4f41eaa24e1dd0

Build ID: 5

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot avatar Aug 13 '24 10:08 dgl-bot

Commit ID: 54525fa4104fc5cdc67df0819628c0d99d0caa8f

Build ID: 6

Status: ❌ CI test failed in Stage [Torch CPU Unit test].

Report path: link

Full logs path: link

dgl-bot avatar Aug 13 '24 11:08 dgl-bot

Commit ID: 9d4f778be278681d7704d5913894c7a580768627

Build ID: 7

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot avatar Aug 14 '24 02:08 dgl-bot

Commit ID: 2979ffdc1c1a9276dbe01221d36c05dd7b6da386

Build ID: 8

Status: ❌ CI test failed in Stage [Distributed Torch CPU Unit test].

Report path: link

Full logs path: link

dgl-bot avatar Aug 14 '24 03:08 dgl-bot

Commit ID: fc462f639c0fa0ea0f187229db3bed374c14d47d

Build ID: 9

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot avatar Aug 14 '24 04:08 dgl-bot

if this pR is ready for review. please add me into the reviewer.

Rhett-Ying avatar Aug 14 '24 06:08 Rhett-Ying

Commit ID: c5e8e10339645ccca53bb95a4ca477c5abca6682

Build ID: 10

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot avatar Aug 14 '24 06:08 dgl-bot

Commit ID: 5d66e2ee93de7c69b13de5487303ba0e86df3475

Build ID: 11

Status: ❌ CI test failed in Stage [Distributed Torch CPU Unit test].

Report path: link

Full logs path: link

dgl-bot avatar Aug 14 '24 07:08 dgl-bot

Commit ID: e6eb3f341ec183ccc42ab94339cc36147852184c

Build ID: 12

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot avatar Aug 19 '24 02:08 dgl-bot

Commit ID: 1384ef89b44a21b634f3eebe35ca1ca4dde618f2

Build ID: 13

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot avatar Aug 19 '24 02:08 dgl-bot

Commit ID: af198ca50e42f50354f74d26880e4eb4565a8cf3

Build ID: 14

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot avatar Aug 19 '24 02:08 dgl-bot

Commit ID: 73441a08db41483faf06a2420a713ce5a07d0f58

Build ID: 15

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dgl-bot avatar Aug 19 '24 02:08 dgl-bot

Commit ID: 723b545d968d0f1874f2d8d3dbe08186571665d0

Build ID: 16

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot avatar Aug 19 '24 10:08 dgl-bot

Commit ID: 2f23bd8a017acb26fb14f62cbc661dc1deb4ec4e

Build ID: 17

Status: ❌ CI test failed in Stage [Distributed Torch CPU Unit test].

Report path: link

Full logs path: link

dgl-bot avatar Aug 19 '24 11:08 dgl-bot

Commit ID: 8170ab610da82ecd04cd4fd2571a0f4a879e4c67

Build ID: 18

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot avatar Aug 20 '24 03:08 dgl-bot

Commit ID: b7b6fdaa24a6585aad377c331639440f6978e46c

Build ID: 19

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dgl-bot avatar Aug 20 '24 03:08 dgl-bot

Commit ID: b65b9438037cef817eedaff2e6aaac7fac71219d

Build ID: 20

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot avatar Aug 21 '24 07:08 dgl-bot

Commit ID: 6a888c2b959608dd12a3606598790b45408ba695

Build ID: 21

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot avatar Aug 21 '24 07:08 dgl-bot

Commit ID: 37922c4eb01cd9f1c7197b8e9c15bc36837e51c7

Build ID: 22

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot avatar Aug 21 '24 07:08 dgl-bot

Commit ID: 3dac145c7e61f53b333c453b44af7d5e21cf27fa

Build ID: 23

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot avatar Aug 21 '24 07:08 dgl-bot

order: https://github.com/dmlc/dgl/pull/7724 partition test case https://github.com/dmlc/dgl/pull/7727 partition https://github.com/dmlc/dgl/pull/7728 dist partition https://github.com/dmlc/dgl/pull/7690 dist partition test case

CfromBU avatar Aug 21 '24 07:08 CfromBU

Commit ID: 3ed4756098cc3c2a068732621257d3880c586c21

Build ID: 24

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dgl-bot avatar Aug 21 '24 07:08 dgl-bot

Commit ID: 59038c0a6e9f54cd983157da49ca84d797e02ae8

Build ID: 25

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot avatar Sep 08 '24 03:09 dgl-bot

Commit ID: dac0c4290329e1f779d0af9ab2fc5db370afeba3

Build ID: 26

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dgl-bot avatar Sep 08 '24 04:09 dgl-bot

Commit ID: 4076dda260d64435f68dd3786c27d4cc01c74cbc

Build ID: 27

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot avatar Sep 08 '24 05:09 dgl-bot