Kinesis Enhanced fan-out consumer ( using consumer ARN)

[senthilkumarkk]

I am able to use consume the Kinesis stream using this jar as a normal consumer. When i updated the user account to Enhanced fan out consumer, i am unable to access the stream.

Do we have any way to access the stream as Enhanced fan out consumer?

[itsvikramagr]

@senthilkumar1987 - I have not tested enhanced fan-out consumers. It's quite likely that it's not supported.

Please go ahead and raise PR for the same.

[chadlagore]

We'd like this as well. We've used a worker thread that calls SubscribeToStream and populates an in-memory queue for the micro-batch consumer to access. This implementation is in Python today however, and not for Spark.

[d4r3topk]

@chadlagore Can you please tell me how you did that?