azure-cosmosdb-spark icon indicating copy to clipboard operation
azure-cosmosdb-spark copied to clipboard

Using changefeedmaxpagesperbatch = 1 on streaming

Open ealsur opened this issue 2 years ago • 0 comments

When reading the change feed on a streaming scenario with changefeedmaxpagesperbatch set to 1 and with Start from Beginning, some of the records are missing from the stream batches.

Increasing the the batch size to 5 or other number greater than 1, fixes the issue.

ealsur avatar Aug 16 '21 10:08 ealsur