amoro icon indicating copy to clipboard operation
amoro copied to clipboard

[Bug]: When log-store.consistency-guarantee.enabled param is turned on, less data will be consumed from Logstore

Open lklhdu opened this issue 2 years ago • 3 comments

What happened?

When log-store.consistency-guarantee.enabled param is turned on, less data will be consumed from Logstore. In the following scenario, the specified kafka topic has 776 pieces of data, but only 277 pieces are read in the end.

image

When log-store.consistency-guarantee.enabled param is turned on, the amount of data read is as expected. image

Affects Versions

master

What engines are you seeing the problem on?

Flink

How to reproduce

No response

Relevant log output

No response

Anything else

No response

Code of Conduct

  • [X] I agree to follow this project's Code of Conduct

lklhdu avatar Jun 07 '23 12:06 lklhdu

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

github-actions[bot] avatar Aug 20 '24 00:08 github-actions[bot]

@lklhdu Have you still followed up on this issue?

zhoujinsong avatar Aug 20 '24 02:08 zhoujinsong

@lklhdu Have you still followed up on this issue?

I'm sorry, I'm not following up on this.

lklhdu avatar Aug 20 '24 02:08 lklhdu

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

github-actions[bot] avatar Aug 10 '25 00:08 github-actions[bot]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'

github-actions[bot] avatar Aug 25 '25 00:08 github-actions[bot]