kinsumer icon indicating copy to clipboard operation
kinsumer copied to clipboard

Remove DescribeStream from startup.

Open ThisWillGoWell opened this issue 1 year ago • 0 comments

Remove the call to kinesisStreamReady(). The DescribeStream endpoint has 10 RPS per account, and the alternative DescribeStreamSummary is 20 RPS per account. This can prevent new readers from starting up due to a thundering heard. Since there is no easy way to check if the stream is ready that is not limited (even in #43 there is a upper limit of 100 RPS on ListShards), we should just remove this check.

If a stream is not ready then the reader will just return an error when it goes to read the shards.

ThisWillGoWell avatar Dec 12 '23 22:12 ThisWillGoWell