Hang Chen

Pulsar delta source connector (task1) : pulsar source connector framework and configuration

2

### Motivation Apache Pulsar is a Cloud-Native Messaging and Event-Streaming Platform. It act as a bridge to connect different systems based on messages. The Pulsar delta source connector is a...

This is the total code of Delta pulsar source connector. Please do not merge. I will divide the source connector into 7 PRs. PR1: Basic framework, configuration field and delta...

[BUG] KoP will consume duplicate message when send multi batches in one produce request for one TopicPartition

1

### Describe the Bug When producer send multi batches in one MemoryRecords, such as protocal [V0, V2] and [V8, +), it will packup multi batches in one entry and stored...

"idleFuture" should reset to "null" after idle bucket closed

2

If we use "idleTimeout" to roll file, once the flush() method called, it will start a delayed thread to close the idle bucketWriter. The delayed thread will call close() method...

Fix data lost when configured multiple ledger directories

16

### Motivation We found one place where the bookie may lose data even though we turn on fsync for the journal. Condition: - One journal disk, and turn on fsync...

Fix compaction throttle imprecise

12

### Motivation When do compaction for an entry log file, it will scan each entry header metadata from beginning to the end of the file. When an entry doesn't deleted,...

Prs need to be included in 4.16.0

1

This issue is used to track Prs that need to be included in the BookKeeper 4.16.0 release. - [x] https://github.com/apache/bookkeeper/pull/3406 - [x] https://github.com/apache/bookkeeper/pull/3361 - [x] https://github.com/apache/bookkeeper/pull/3383 - [x] https://github.com/apache/bookkeeper/pull/3384 -...

add bookie expand or shrink directories operation guide

5

### Motivation Currently, BookKeeper website doesn't have any operation guide for shrink or expand journal/ledger directories. ### Changes Add the operation guide for shrink or expand journal/ledger directories.

The PR https://github.com/apache/bookkeeper/pull/3340 breaks the `backward-compact` test, after this PR merged, the `backward-compact-tests` in CI don't run at all. https://github.com/apache/bookkeeper/runs/6928923882?check_suite_focus=true

[improve][monitor]Add prometheusRawMetricsProvider support

12

### Motivation Currently, Pulsar Prometheus metric framework can generate new metrics from `PrometheusRawMetricsProvider`, and the current PrometheusMetricsProvider implementation doesn't support this interface, which leads to new created PrometheusMetricProvider instance can...