pulsar
pulsar copied to clipboard
[improve][broker] Taking message deduplication snapshot when closing topic
Motivation
The current implementation of message deduplication snapshot-taking may leave a very huge lag when traffic is high. if load balancer or someone tries to unload/load this topic the loading process may taking very long time.
Modifications
- Make message deduplication
snapshotmethod return a future. - Support force taking snapshot without interval condition check.
- Taking the snapshot when closing the topic
Verifying this change
- [x] Make sure that the change passes the CI checks.
Documentation
- [ ]
doc - [ ]
doc-required - [x]
doc-not-needed - [ ]
doc-complete
@mattisonchao Please fix the ci check failures
sorry, this PR still need some changes. @dao-jun