dynein icon indicating copy to clipboard operation
dynein copied to clipboard

Feature Suggestion: Add a way to show progress of `export`

Open andres-lowrie opened this issue 2 years ago • 4 comments

Hello 👋

Some sort of --progress flag that shows a progress bar would be really cool; could help show info with long running exports

andres-lowrie avatar May 12 '22 16:05 andres-lowrie

Hi, thank you for reaching out. I think it is a fascinating function. But unfortunately, DynamoDB does not provide an exact table size. Please see API reference.

TableSizeBytes The total size of the specified table, in bytes. DynamoDB updates this value approximately every six hours. Recent changes might not be reflected in this value.

So, even if we implement a progress bar, it is not correct information. I have a concern it may be frustrating the user. Theoretically, there are cases in which the export cannot finish even if the progress bar reaches 100%.

In my humble opinion, an infinite 100% progress bar but not completion is stressful more than no information. Do you have any good ideas to address this problem or your opinion regarding this?

StoneDot avatar Jun 18 '23 08:06 StoneDot

I think a progress bar may confuse the user, but showing information on current status like (number of processed items)/sec, (item size)/sec, (total processed items), and (total processed item size) may be useful.

StoneDot avatar Jun 18 '23 09:06 StoneDot

that's a good idea, the (item size)/sec would be very useful. Would let the user calculate the progress in a way.

andres-lowrie avatar Jun 18 '23 15:06 andres-lowrie

Thank you for your comment. We have concluded a way to mitigate the pain. The rest of the work is implementing this feature.

StoneDot avatar Jun 20 '23 15:06 StoneDot