amazon-kinesis-client icon indicating copy to clipboard operation
amazon-kinesis-client copied to clipboard

Published 20 hours ago • verified publisher icon awslabs

KCL v2 consumer does not backoff on ProvisionedThroughputExceededException

Open vtlkvl opened this issue 5 years ago • 2 comments

In KCL v1 com.amazonaws.services.kinesis.clientlibrary.lib.worker.ProcessTask used to fetch records and yield a short message on ProvisionedThroughputExceededException using ThrottlingReporter and then backoff. In KCL v2 records are fetched upstream by PrefetchRecordsPublisher and then passed to software.amazon.kinesis.lifecycle.ProcessTask. PrefetchRecordsPublisher handles ProvisionedThroughputExceededException as a common SDK error, specifically it logs a stack trace and does not force a backoff. Is it an intended change or a regression?

vtlkvl avatar Apr 08 '19 14:04 vtlkvl

Any updates on this issue? I see pull request https://github.com/awslabs/amazon-kinesis-client/pull/716, but this has not been merged.

royyeah avatar Feb 10 '21 14:02 royyeah

any updates?

LuShuai avatar Aug 10 '22 10:08 LuShuai