graph-node icon indicating copy to clipboard operation
graph-node copied to clipboard

Large arrays take a long time to copy during grafting

Open azf20 opened this issue 3 years ago • 8 comments

We really need to do something about large arrays - there are some grafts in shard_i involving subgraphs with large arrays where a batch to copy data took over an hour when each batch should really only take 5 minutes. This PR tries to mitigate that, but a lot of the data we store comes from large arrays, and we need to do something better there.

azf20 avatar Apr 29 '22 13:04 azf20