pulsar-rs icon indicating copy to clipboard operation
pulsar-rs copied to clipboard

Producer send incomplete batch after delay

Open KannarFr opened this issue 3 years ago • 2 comments

A producer using batch is waiting for the batch to be full (batch_size reached) to send a message. Whenever the batch is created for a long time if the batch_size is not reached the batch seems not sent.

https://github.com/streamnative/pulsar-rs/blob/c31fc8335e4e321c85e0024aa4189c318a581082/src/producer.rs#L592

KannarFr avatar Jun 15 '22 23:06 KannarFr

Generally you'd have a trigger that pushes batches whatever the fulfillment of the batch buffer. This trigger should also have a default value but should remain configurable, depending on use cases.

StevenLeRoux avatar Jun 16 '22 13:06 StevenLeRoux

linked to https://github.com/streamnative/pulsar-rs/issues/104

miton18 avatar Jul 21 '22 12:07 miton18

@KannarFr I suspect this is a duplicate of #104. If you can confirm it, we keep only #104.

tisonkun avatar Nov 25 '22 13:11 tisonkun

It is.

KannarFr avatar Nov 25 '22 13:11 KannarFr