kafka

kafka copied to clipboard

KAFKA-19968: Fix tiered storage quota enforcement issues

1

###Problem: 1. Race condition and quota leaks: Multiple threads could check quota before any recorded usage, allowing all to bypass limits simultaneously. Additionally, in multi-partition fetches, quota was reserved per-partition...

nandini12396

KAFKA-19969: Add Per-Topic Observability Metrics for Remote Fetch Quota Enforcement

1

Remote fetch quota enforcement lacks per-topic visibility, making it difficult to identify which topics consume the most quota or experience throttling. Add 4 new per-topic metrics: - RemoteFetchQuotaBytesPerSec: quota bytes...

nandini12396

KAFKA-19674 - Disallow create too many partitions in ZK mode

1

This PR - is a backporting of https://github.com/apache/kafka/pull/20485 to Kafka 3.9 and - applies the same 10000 max new partitions limit when running in ZK mode

edoardocomar

KIP-780: Support fine-grained compression options

2

This PR implements [KIP-780](https://cwiki.apache.org/confluence/display/KAFKA/KIP-780%3A+Support+fine-grained+compression+options): Per-codec compression configuration. In addition to compression.type and compression.level (KIP-390), Kafka now exposes tunable codec-specific parameters for Producer, Broker, and Topic configs. Supported options: - GZIP:...

see-quick

KAFKA-19952: When remote storage keep outage status. the local segment never get deleted

1

Test Case: Topic enable remote storage: Local retention time: 10 minutes Remote retenton time: 20 minutes Keep run producer to send. and pick one time after 20 minutes to set...

jiafu1115

KAFKA-14412: Use shared cache for Task offset sums

3

Instead of reading Task state offsets for non-open Tasks from the `.checkpoint` file, we now maintain an in-memory cache of the latest changelog offsets for every Task on the instance....

nicktelford

KAFKA-18981: Fix flaky test QuorumControllerTest.testMinIsrUpdateWithElr

1

# [KAFKA-18981] Deflake `testMinIsrUpdateWithElr` by maintaining broker heartbeats during waits ### What This PR removes nondeterminism in `testMinIsrUpdateWithElr` by ensuring broker sessions do not expire while the test is waiting/sleeping,...

Anshul-creator

The new test framework does not yet support the SASL_SSL security protocol; we should add support for it.

m1a2st

KAFKA-19851 Delete dynamic config that were removed by Kafka

3

### Problem https://issues.apache.org/jira/browse/KAFKA-19851 When upgrading from Kafka 3.x to 4.0, the metadata log may contain dynamic configurations that were removed in 4.0 (e.g., `message.format.version` per KIP-724). These removed configs cause...

0xffff-zhiyan

In this PR, we corrected the argument order in assertEquals within the trogdor package.

samarth-ksolves