bookkeeper
bookkeeper copied to clipboard
apache
Apache BookKeeper - a scalable, fault tolerant and low latency storage service optimized for append-only workloads
Abstraction that hides implementation details of ledger manager throws exceptions specific to the implementation (ZK in this case). E.g. this makes no sense for the Etcd based ledger manager.
**BUG REPORT** There are two methods in AbstractZkLedgerManager. 1. **registerLedgerMetadataListener** https://github.com/apache/bookkeeper/blob/677ccec3eb84f5be1b3556537871e14eb5e8359c/bookkeeper-server/src/main/java/org/apache/bookkeeper/meta/AbstractZkLedgerManager.java#L389-L409 2. **unregisterLedgerMetadataListener** https://github.com/apache/bookkeeper/blob/677ccec3eb84f5be1b3556537871e14eb5e8359c/bookkeeper-server/src/main/java/org/apache/bookkeeper/meta/AbstractZkLedgerManager.java#L412-L426 **The initial data** listeners: 1: watcherSet(watcher1) **Thread one: doing unregisterLedgerMetadataListener, it unregister (1, watcher1)** It get...
It looks like ZkLedgerUnderreplicationManager.isLedgerReplicationEnabled() can cache the state and either use watcher (see notifyLedgerReplicationEnabled) + enableLedgerReplication/disableLedgerReplication or just some time interval (10sec or so) to cache the value for. AFAICT...
**BUG REPORT** #### In Auditor, we will checkAllLedger in the scheduled task `scheduleCheckAllLedgersTask`. https://github.com/apache/bookkeeper/blob/677ccec3eb84f5be1b3556537871e14eb5e8359c/bookkeeper-server/src/main/java/org/apache/bookkeeper/replication/Auditor.java#L1333 #### In ReplicationWorker, we will check ledgerFragment to replicate. https://github.com/apache/bookkeeper/blob/677ccec3eb84f5be1b3556537871e14eb5e8359c/bookkeeper-server/src/main/java/org/apache/bookkeeper/replication/ReplicationWorker.java#L369 #### Both will invoke `openLedgerNoRecovery`. It...
**BUG REPORT** ***Describe the bug*** When running with `httpServerEnabled` set to true, `/metrics` endpoint stops sending a `content-type` header (this uses the `MetricsService`, see code here https://github.com/apache/bookkeeper/blob/28dee8464764b0edceeb31ce24424f0947b5789b/bookkeeper-server/src/main/java/org/apache/bookkeeper/server/http/service/MetricsService.java). With the `httpServerEnabled=false`...
**improve** As the Decommissioning bookie case， always change the bookie status to readonly firstly, and then wait some data expired, but always it has some ledgers (about 100+ -- 300+)...
**BUG REPORT** ***Describe the bug*** Autorecovery running standalone: ``` 2022-06-14T05:14:25,461 [main] INFO org.apache.bookkeeper.client.BookKeeperAdmin - Resetting LostBookieRecoveryDelay value: 0, to kickstart audit task 2022-06-14T05:14:25,461 [main] DEBUG org.apache.bookkeeper.meta.ZkLedgerUnderreplicationManager - setLostBookieRecoveryDelay() 2022-06-14T05:14:25,612 [main]...
Writer owns the metadata of the current ensemble ensemble only. Previous ensemble segments of the same ledger can freely modified by the replication worker. In the current code, write ledger...
**Describe the bug** ``` java.lang.NullPointerException: null at org.apache.bookkeeper.client.RackawareEnsemblePlacementPolicyImpl.isEnsembleAdheringToPlacementPolicy(RackawareEnsemblePlacementPolicyImpl.java:1261) ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.RackawareEnsemblePlacementPolicyImpl.replaceBookie(RackawareEnsemblePlacementPolicyImpl.java:681) ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.RackawareEnsemblePlacementPolicy.replaceBookie(RackawareEnsemblePlacementPolicy.java:114) ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.BookieWatcherImpl.replaceBookie(BookieWatcherImpl.java:278) ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.EnsembleUtils.replaceBookiesInEnsemble(EnsembleUtils.java:71) ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.LedgerHandle.lambda$ensembleChangeLoop$2(LedgerHandle.java:1908) ~[org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.MetadataUpdateLoop.writeLoop(MetadataUpdateLoop.java:122) [org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2] at org.apache.bookkeeper.client.MetadataUpdateLoop.run(MetadataUpdateLoop.java:111) [org.apache.bookkeeper-bookkeeper-server-4.9.2.jar:4.9.2]...
**BUG REPORT** ` Feb 15, 2019 12:11:27 PM com.scurrilous.circe.checksum.Crc32cIntChecksum WARNING: Failed to load Circe JNI library. Falling back to Java based CRC32c provider ` i have this warning when i...
