azure-service-bus icon indicating copy to clipboard operation
azure-service-bus copied to clipboard

ASB DLQ metrics not sent to log analytics

Open strat-alex opened this issue 3 years ago • 6 comments

Hi all,

in an effort to centralize all important logging to log analytics, I am exploring the diagnostics integration for ASB. More specifically: I wanted to see if I can query the amount of DLQ messages in Logging Analytics.

I can see the DLQ messages in the Metrics tab, but when I look at the AzureMetrics table in LA, I can only find IncomingMessages and IncomingRequests as entries. Nothing about dead lettered messages in any of those tables. I'm wondering if there's only partial support at the moment?

To clarify: the setup is: message sender to topic -> 1 subscription with DLQ enabled. On the subscription level, the messages get dead lettered, as I verified in azure portal and in the servicebus explorer. I know DLQ messages do not live on the topic level but on the subscriber level.

In the interest of gathering all information, I also tested this for queues and found the result to be the same. The metrics tab in the portal shows the correct dead lettered messages count, the LA content does not. Even after 10+ minutes of waiting for the sync to happen to LA. The metrics that I see in the AzureMetrics LA table are: IncomingMessages, IncomingRequests, OutgoingMessages, CompleteMessages.

From what I gather in the AzureMetrics table in LA, there is only the context of the ASB, not of queues or topics. I mean: it seems that the metrics are gathered for the entire namespace, and not on a more granular level.

The hands-on solution right now is to query the number of DLQ messages using PS/C#/... in a function or something and push that into LA. But, I was hoping for a less manually involved solution.

Am I missing something?

Thanks in advance!

Actual Behavior

  1. DLQ metrics information is missing from the LA logs

Expected Behavior

  1. DLQ metrics information to be queriable for topic subscriptions and queues in the LA logs

strat-alex avatar Apr 19 '21 03:04 strat-alex

We have assigned an engineer to look into this behavior.

EldertGrootenboer avatar Aug 05 '22 20:08 EldertGrootenboer

Hi @alexv-be , we did some investigation and figured out that currently this behavior is by design and documented here:https://learn.microsoft.com/en-us/azure/service-bus-messaging/monitor-service-bus-reference#message-metrics.

Not all metrics are exportable to Log Analytics via diagnostic settings. We are looking at trying to support more metrics in future however there is no clear ETA yet.

cc : @EldertGrootenboer

Saglodha avatar Jul 24 '23 07:07 Saglodha

Thank you for suggesting this feature. However, since we we have an internal dependency for this, we've added it to our backlog. We don't have specific timelines for this, but will get back on this once the internal dependency has been resolved.

EldertGrootenboer avatar Jul 31 '23 15:07 EldertGrootenboer

A quick update on this, the internal dependency is still open, so we currently don't have an ETA on when development might start on this. For now, to help us give this the right priority, it would be helpful to see others vote and support this feature, as well as explain their scenarios.

EldertGrootenboer avatar Oct 13 '23 19:10 EldertGrootenboer