[feat][offload] Support namespace/topic level auto trigger offload policy.

[tjiuming]

Search before asking

• [X] I searched in the issues and found nothing similar.

Motivation

Currently, Pulsar only supports global offload auto trigger policy: managedLedgerOffloadAutoTriggerSizeThresholdBytes and managedLedgerOffloadTimeThresholdInSeconds(see: https://github.com/apache/pulsar/pull/17398), this is a very coarse granularity. For the purpose of more fine control of auto trigger offload, we'd better to support namespace/topic level auto trigger offload policy.

Solution

Add the following configurations:

// Namespace -> managedLedger size
private final Map<String, Long> managedLedgerOffloadNamespaceSizeThresholdBytes;
// Topic -> managedLedger size
private final Map<String, Long> managedLedgerOffloadTopicSizeThresholdBytes;
// Namespace -> time threshold in seconds
private final Map<String, Long> managedLedgerOffloadNamespaceTimeThresholdSeconds;
// Topic -> time threshold in seconds
private final Map<String, Long> managedLedgerOffloadTopicTimeThresholdSeconds;

Alternatives

No response

Anything else?

No response

Are you willing to submit a PR?

• [X] I'm willing to submit a PR!

[tjiuming]

@codelipenghui assign me plz

[ethqunzhong]

This is a practical proposal!

[github-actions[bot]]

The issue had no activity for 30 days, mark with Stale label.