spring-cloud-stream icon indicating copy to clipboard operation
spring-cloud-stream copied to clipboard

Published 20 hours ago • verified publisher icon spring-cloud

Using KCL Version 2.0 to support fan-out with Push rather than Pull

Open TaurusLondon opened this issue 4 years ago • 5 comments

Hello, Kinesis Client Library Version 2.0 now supports fan-out with data being pushed to consumers (https://docs.aws.amazon.com/streams/latest/dev/enhanced-consumers.html). I wonder if spring-cloud-stream-binder-aws-kinesis can use this version to support the PUSH approach too? Thanks

TaurusLondon avatar Mar 30 '20 11:03 TaurusLondon

We can't do that until we will be able to upgrade to AWS SDK v2 the whole stack: https://github.com/spring-projects/spring-integration-aws/issues/155

artembilan avatar Mar 30 '20 13:03 artembilan

Thanks, I take it that you are planning to upgrade to AWS SDK v2?

TaurusLondon avatar Mar 31 '20 08:03 TaurusLondon

That's right, but this "push" issue is going to be reconsidered only when we will have upgraded already to AWS SDK v2... See all those linked issues.

artembilan avatar Mar 31 '20 14:03 artembilan

Any timeline on integration with KCL 2.0. Does any of the interfaces will change once integration with KCL2.0 complete?

paparaju avatar Dec 01 '21 06:12 paparaju

@paparaju ,

we cannot do anything here until this one: https://github.com/spring-projects/spring-integration-aws/issues/155.

I don’t expect too much changes in our interfaces: only new dependencies and some new options. And probably new features.

artembilan avatar Dec 02 '21 03:12 artembilan

@artembilan Is there any update on AWS 2.x migration, it is almost 11 months from the time I pinged last here .I am also keen to contribute, please let me know how can I start doing that.

paparaju avatar Nov 03 '22 20:11 paparaju

Sorry, until AWS Labs fixes issues mentioned in that SI-AWS issue I've just commented your back, we cannot move on.

artembilan avatar Nov 03 '22 20:11 artembilan