s3s3mirror icon indicating copy to clipboard operation
s3s3mirror copied to clipboard

"possible queue overflow" Errors

Open JustinLawler opened this issue 3 years ago • 3 comments

Getting a lot of "possible queue overflow" errors when syncing :(

I'm running with version 1.2.8, but seems like happening with 2.1.5 also.

Thread-1 ERROR: org.cobbzilla.s3s3mirror.MirrorMaster - Error submitting job: java.util.concurrent.FutureTask@e357011[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@350024c3[Wrapped task = ************]], possible queue overflow

JustinLawler avatar Oct 09 '21 11:10 JustinLawler

Seems to happen a lot when trying to sync sub-folders. Gets completely locked-up and goes nowhere.

s3s3mirror.sh -n -i -X -C -t 50 bucket_1/aaa/bbb/ccc/ bucket_2/aaa/bbb/ccc/

Note - our S3 buckets have over 5M objects.

JustinLawler avatar Oct 11 '21 16:10 JustinLawler

+1 I'm having the same issue

sonlexqt avatar Nov 24 '21 05:11 sonlexqt

+1 I have the same issue

fernandomatsuosantos avatar Jul 25 '22 21:07 fernandomatsuosantos