rogerducky comments

Repositories
Issues
Comments

Results 3 comments of


                                            rogerducky

Confirm NextShardIterator key exist to fetch from existing consumer shard

Fully supporting shard split/merge logic requires some rework. This post seems to explain it fairly well: https://brandur.org/kinesis-by-example To summarize the above: In "maintenance" task: List all shards. Update checkpointer metadata...

Confirm NextShardIterator key exist to fetch from existing consumer shard

Okay. Realized why this project hasn't been active recently: AWS allowed lambdas to act as consumers, so those wanting to use Python can just use a lambda triggering on KDS...

Confirm NextShardIterator key exist to fetch from existing consumer shard

Understood. I was confused because most of the activity around packages similar to this one died around late 2019/early 2020. Then I found out AWS had hooked up lambda support...