Nandini Singhal

KAFKA-19967: Reduce GC pressure in tiered storage read path using direct memory buffers

2

This change addresses high GC pressure by allocating tiered storage fetch buffers in direct (off-heap) memory instead of the JVM heap. When direct memory is exhausted, the system gracefully falls...

When the index cache is full and evicts entries, there's a race: 1. Entry marked for cleanup (markedForCleanup=true) 2. Index files renamed to .deleted 3. Entry may still be in...

KAFKA-19968: Fix tiered storage quota enforcement issues

1

###Problem: 1. Race condition and quota leaks: Multiple threads could check quota before any recorded usage, allowing all to bypass limits simultaneously. Additionally, in multi-partition fetches, quota was reserved per-partition...

KAFKA-19969: Add Per-Topic Observability Metrics for Remote Fetch Quota Enforcement

1

Remote fetch quota enforcement lacks per-topic visibility, making it difficult to identify which topics consume the most quota or experience throttling. Add 4 new per-topic metrics: - RemoteFetchQuotaBytesPerSec: quota bytes...

KAFKA-19970: Add configurable TTL for tiered storage index cache eviction

1

Caffeine cache currently only uses size-based eviction with frequency buckets. Within same frequency bucket, larger entries are always evicted. This causes old (smaller) index files to stay in cache indefinitely...