kafka icon indicating copy to clipboard operation
kafka copied to clipboard

KAFKA-19952: When remote storage keep outage status. the local segment never get deleted

Open jiafu1115 opened this issue 1 month ago • 1 comments

Test Case: Topic enable remote storage: Local retention time: 10 minutes Remote retenton time: 20 minutes Keep run producer to send. and pick one time after 20 minutes to set the AWS S3 permisssion to let the remote upload fail. After 1 hour. you will see the local segments keep increase and save about 1 hours even the both local/remote retention time < 20 minutes. So we need one protect for this case to avoid the local disk keep increase forever util the outage recovered.

image image image

jiafu1115 avatar Dec 02 '25 13:12 jiafu1115

A label of 'needs-attention' was automatically added to this PR in order to raise the attention of the committers. Once this issue has been triaged, the triage label should be removed to prevent this automation from happening again.

github-actions[bot] avatar Dec 10 '25 03:12 github-actions[bot]