ente icon indicating copy to clipboard operation
ente copied to clipboard

Ente CLI: RESTY stream error why syncing large collection

Open chrisguidry opened this issue 1 year ago • 0 comments

Description

I have a large collection of photos and videos on ente and I'm working on establishing a continual backup using ente CLI (ente export). I'm working through my first full sync, which I expect to take several days to a week. However, the process occasionally dies with errors like this:

[[email protected]] 2024/06/25 10:55:43 start sync
[[email protected]] 2024/06/25 10:55:44 Starting file download
[[email protected]] 2024/06/25 10:55:45 total entries 122918
[[email protected]] 2024/06/25 10:56:06 [56247/122918] Sync 2015-11-08T19-52-33__00.mp4 for album 2015
[[email protected]] 2024/06/25 10:56:06 Downloading 2015-11-08T19-52-33__00.mp4 (84.5 MB)
2024/06/25 10:56:18.652556 ERROR RESTY stream error: stream ID 1; INTERNAL_ERROR; received from peer, Attempt 1
[[email protected]] 2024/06/25 10:56:18 process_files took 33.608509673s
[[email protected]] 2024/06/25 10:56:18 Error syncing files: error downloading file 59571534: stream error: stream ID 1; INTERNAL_ERROR; received from peer
Error syncing account [email protected]: error downloading file 59571534: stream error: stream ID 1; INTERNAL_ERROR; received from peer

What I'm finding is that my process can run for many hours successfully, but once it hits this error, I have to wait an indeterminate amount of time before I can successfully resume. Am I being rate limited or hitting a quota? If so, can you share the parameters so I can adjust the timing of my job?

I'm not worried about how fast I get through this, just that it will continue without my constant supervision and intervention.

Thank you for the wonderful service, ente is the best!

Version

cli-v0.1.15

What product are you using?

Ente Photos

What platform are you using?

Desktop - Linux

chrisguidry avatar Jun 25 '24 11:06 chrisguidry