Kafka Events batching

[AishD3]

Hi @oscerd , we would like batch some amount of kafka records while a file is created in data lake . We are using below configs in Kafka Connect for that , but batching is not working , is it correct and am I missing something.

camel.aggregation.size: 5
camel.aggregation.timeout: 5000

[oscerd]

https://camel.apache.org/camel-kafka-connector/4.0.x/user-guide/aggregation.html

[AishD3]

@oscerd Yes we referred to this , but do we need to add camel.beans.aggregate=#class:org.apache.camel.kafkaconnector.aggregator.StringAggregator

as well , or only

camel.aggregation.size: 5 camel.aggregation.timeout: 5000

is enough

[oscerd]

You need to add a bean because otherwise Camel don't know how to aggregate.

[AishD3]

Thanks a lot its working