kafka-elasticsearch-injector icon indicating copy to clipboard operation
kafka-elasticsearch-injector copied to clipboard

Published 20 hours ago • verified publisher icon inloco

Synchronous flush

Open rhnasc opened this issue 7 years ago • 0 comments
trafficstars

KAFKA_CONSUMER_BATCH_SIZE controls when the in-memory events are flushed to ES.

However some topics may have small throughput, not having their events flushed at all.

It would be nice to have a second parameter controlling a recurrent tick so the in-memory events are flushed even when they do not meet the batch size requirement

rhnasc avatar Aug 28 '18 20:08 rhnasc