cubed icon indicating copy to clipboard operation
cubed copied to clipboard

Estimate quantity of data that will be pulled / egressed

Open TomNicholas opened this issue 10 months ago • 0 comments

@betolink was asking if there is a way to keep track in Dask of the accumulative network traffic for pulling data, but I think Cubed should have enough information to know before execution time how many bytes of data will need to be read from storage. It could even maybe know whether this would involve a cross-region egress or not.

Closely related to #334, in fact its arguably a necessary step for that issue.

TomNicholas avatar Dec 20 '24 19:12 TomNicholas