kafka-connect-lambda icon indicating copy to clipboard operation
kafka-connect-lambda copied to clipboard

Published 20 hours ago • verified publisher icon Nordstrom

Batch max size question

Open Amertz08 opened this issue 4 years ago • 4 comments

We are attempting to reduce the number of messages being processed by each lambda invocation. We have batching enabled but it doesn't appear that you can configure the message count. It looks like there is a hard coded value for the bytes size of the batch here https://github.com/Nordstrom/kafka-connect-lambda/blob/eec53066f588cce5255a6d98086fb02cca695805/src/main/java/com/nordstrom/kafka/connect/lambda/LambdaSinkTask.java#L26.

Is it even possible?

Amertz08 avatar Jul 02 '20 14:07 Amertz08