pulsar

pulsar copied to clipboard

[improve][pip] PIP-317: Add `bookkeeperDeleted` field to show whether a ledger is deleted from the bookie while using tiered storage

6

Releted PR/issue: #20833 - [ ] `doc` - [ ] `doc-required` - [x] `doc-not-needed` - [ ] `doc-complete`

dragonls

[fix][txn] fix concurrent error cause txn stuck in TransactionBufferHandlerImpl#endTxn

1

Fixes https://github.com/apache/pulsar/issues/23550 ### Motivation After diving into the code, finding that there is a concurrent error in TransactionBufferHandlerImpl#checkRequestCredits(), checkPendingRequests(), which would cause the above issue. Currently, we have config TransactionBufferClientMaxConcurrentRequests...

TakaHiR07

[improve][broker] Make dispatch rate limiter more precise

4

### Motivation The Dispatch rate limiter serves two purposes: 1. Limit your consumption speed 2. When there are many backlogs, bk can be protected to avoid excessive I/O But the...

poorbarcode

[fix][client] Fix clearIncomingMessages so that it doesn't leak memory while new entries are added

5

### Motivation The current ConsumerBase.clearIncomingMessage has a race condition when using Shared or Key_Shared subscription type. https://github.com/apache/pulsar/blob/69a45a11e22c1d963391110fb3488c9b9f98f759/pulsar-client/src/main/java/org/apache/pulsar/client/impl/ConsumerBase.java#L1224-L1229 When using Shared or Key_Shared, this method is called in `redeliverUnacknowledgedMessages` while new...

lhotari

[improve][broker] Clean up config changes without a PIP since the 4.0 LTS

2

- Remove `managedLedgerOffloadReadThreads` from https://github.com/apache/pulsar/pull/24025 - Remove `managedLedgerMaxReadsInFlightPermitsAcquireTimeoutMillis` and `managedLedgerMaxReadsInFlightPermitsAcquireQueueSize` from https://github.com/apache/pulsar/pull/23901 - Remove `managedLedgerCursorResetLedgerCloseTimestampMaxClockSkewMillis` from https://github.com/apache/pulsar/pull/22792 The configs above only increase the complexity and are hard to configure. Add...

BewareMyPower

[fix] [ml] fix key_shared mode delivery are order out order after a consumers reconnection

9

### Motivation - There is an issue that leads to repeated consumption when replay reading and `cursor.rewind` execute concurrently. **Information** - `read-position`: `3:21` - `mark-deleted-position: `3: -1` - `acked messages`:...

poorbarcode

[improve][meta] Stop election operations when LeaderElectionImpl gets closed

1

### Motivation In some tests, I noticed that LeaderElectionImpl could continue to make operations and override the closed state. ### Modifications Add checks if the internalState is Closed ### Documentation...

lhotari

[fix][broker] Correct the 'connected' status in topic stats of multi-partition topic for geo replication

1

### Motivation The default value of the `connected` field in `org.apache.pulsar.common.policies.data.stats.ReplicatorStatsImpl` is false, and the logic for accumulating each partition (`org.apache.pulsar.common.policies.data.stats.ReplicatorStatsImpl#add`) is `this.connected &= stats.connected;`. This causes the status of...

Coselding

[improve][broker] Add dedicated partition configuration for system topics to reduce resource usage

10

### Motivation The number of partitions for creating system topics depends on the value of the "defaultNumPartitions" configuration field, but this field is also the number of partitions for automatically...

zjxxzjwang

### Motivation Upgrade K8S java client lib to latest version. This version is pulling the latest version of `org.bitbucket.b_c:jose4j:jar:0.9.4:compile` which has a fix for: ``` ┌──────────────────────────────────────┬────────────────┬──────────┬────────┬───────────────────┬───────────────┬─────────────────────────────────────────────────────────────┐ │ Library │ Vulnerability...

merlimat