pulsar

pulsar copied to clipboard

InflightReadsLimiter - limit the memory used by reads end-to-end (from storage/cache to the write to the consumer channel)

1

### Motivation Broker can go out of memory due to many reads enqueued on the PersistentDispatcherMultipleConsumers dispatchMessagesThread (that is used in case of dispatcherDispatchMessagesInSubscriptionThread set to true, that is the...

eolivelli

Fixes https://github.com/apache/pulsar/issues/17673 ### Motivation Currently, Pulsar only supports global offload auto trigger policy: `managedLedgerOffloadAutoTriggerSizeThresholdBytes` and `managedLedgerOffloadThresholdInSeconds` (see: https://github.com/apache/pulsar/pull/17398). this is a very coarse granularity. For the purpose of more fine...

tjiuming

### Search before asking - [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and found nothing similar. ### Version 2.10.1 ### Minimal reproduce step 2022-11-03 10:51:12,406 ERROR [https-jsse-nio-127.0.0.1-25914-exec-58][ROOT][PulsarTopicProcessor.java 235] PulsarException in get...

liliang950210

PIP-191: Support batched message using entry filter

22

discuss mail-thread: https://lists.apache.org/thread/cdw5c2lpj5nwzl2zqyv8mphsqqv9vozj ## Motivation - This PIP introduces a way to support batched message using entry filter without having to deserilize the entry, through restricting same properties of messages...

AnonHxy

[fix][broker] Fix thread-safety issue with currentLedgerEntries and currentLedgerSize fields

2

### Motivation - currentLedgerEntries and currentLedgerSize fields in the ManagedLedgerImpl class are currently mutated and read from multiple threads which is a problem. - one solution is to make the...

lhotari

[Doc]

2

### Search before asking - [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and found nothing similar. ### What issue do you find in Pulsar docs? https://pulsar.apache.org/docs/next/concepts-messaging/#subscriptions “In the diagram below, Consumer...

startjava

[Doc] Fix links to Google docs page in the documentation guide

2

### Search before asking - [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and found nothing similar. ### What issue do you find in Pulsar docs? There are still several links to...

tisonkun

Retry producing on next partition if possible when a partit…

5

…ion is not connected **Motivation** When a topic is a partitioned topic and a partition is not available for producing messages, currently pulsar client will still try to produce messages...

pkumar-singh

### Motivation Add offload managedLedgerOffloadThreshold RestAPI and CLI tools ### Does this pull request potentially affect one of the following parts: *If the box was checked, please highlight the changes*...

tjiuming

Flaky-test: MetadataStoreStatsTest#testBatchMetadataStoreMetrics

1

### Search before asking - [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and found nothing similar. ### Example failure https://github.com/labuladong/pulsar/actions/runs/3376057575/jobs/5603501145#step:10:1208 ### Exception stacktrace Full exception stacktrace Error: Tests run: 7, Failures:...

labuladong