Propan
Propan copied to clipboard
Feature/Question: consume a batch of messages
I'm not sure if this is already possible, but I'm wondering if there is a way to consume a batch of messages off a topic (I'm working with Kafka).
I want to consume either 5 minutes of messages or 50,000 messages (whichever comes first) and then process that collection of messages as a batch.
Right now, each handler is executed once for each message so I don't see a straightforward way to pull multiple messages in one function.
Is there a way to do this currently? If not, do you think this is something that could be possible?
@chrisgoddard sorry, but in the current implementation there is no way to consume batches But you can find this functionality in the V2, just wait 2 weeks for release
It would be great to add support for Redis-Streams too.
@chrisgoddard please, check FastStream for this feature
Tomorrow will be a great release
All your Propan code should works with FastStream correctly: just migrate @handle
to @subscriber
and change some imports paths