akka-kafka icon indicating copy to clipboard operation
akka-kafka copied to clipboard

Multiple workers actors

Open eugenemiretsky opened this issue 8 years ago • 1 comments

There are many stream consumer actors created (FSMStreams), but only one worker actor - this essentially turns any non-trivial worker into a bottle neck - would it make sense to have a consumer actor per stream?

eugenemiretsky avatar May 03 '16 20:05 eugenemiretsky

You only need provide an ActorRef to any of the Consumers in this library. They can be backed by a standard actor or any of the existing akka routers or other pooling mechanism.

In addition the actor ref provided to this library doesnt necessarily need to be the actor that is sending the StreamFSM.Processed acknowledgements back to the consumer, any actor that gets forwarded a message from the consumer can respond to it. (Assuming sender is properly maintained across forwarding)

Is there another requirement you have that is not met here?

Cheers!

sclasen avatar May 03 '16 21:05 sclasen