Feature request/suggestion show estimated messages per seconds per topic

[elmarx]

Hey,

I have a feature request/suggestion. To get an overview of topics it would be nice to know how much messages to expect (e.g. per minute). Of course the number could vary over the span of e.g. a day, but already an estimate for the magnitude of messages (thoundands per minutes vs less than one per minute) would also be a helpful information.

Cheers :)

[rikimaru0345]

• [ ] Track "speed" of a topic: incoming messages per minute / hour.
• [ ] Explore persistent storage options so stats don't reset when backend instances restart; alternatively just show a warning like "This value represents data from just the last X minutes"...
• [ ] Also show total message count in overview (even if its just an estimate); just a sum of the messageCount column over all partitions.
• [ ] Later on - with persistent storage - we could even display a small graph to show how the rate changes over time.

[ckarmann]

For topics that have a retention time, it is easy to calculate an average: it's the number of messages in the topic (based on offsets) divided by the retention time.

A more general solution would be to get the offset position "one hour ago" and substract that to the current high watermark of each partition, to get the number of messages in the last hour. So no need for persistence storage in my opinion.