elastic-apm-mule3-agent icon indicating copy to clipboard operation
elastic-apm-mule3-agent copied to clipboard

Service Map cannot connect the services (both services uses the same agent)

Open alidrsn opened this issue 2 years ago • 14 comments

alidrsn avatar Nov 09 '22 18:11 alidrsn

Hi @alidrsn Are you referring to the Service Map connection, or seeing 2 Mule flows as the same trace in the APM trace view?

michaelhyatt avatar Nov 10 '22 00:11 michaelhyatt

Hi @alidrsn Are you referring to the Service Map connection, or seeing 2 Mule flows as the same trace in the APM trace view?

Hi @michaelhyatt, yes I mean two services are not linking/drawing each other on Kibana/Service Map

According to elastic documentation, traceparent header would be missing. Is there any other configuration required from Mulesoft side ?

alidrsn avatar Nov 10 '22 10:11 alidrsn

Can you please retrieve the JSON documents representing the transactions and spans, so I can have a look at it?

michaelhyatt avatar Nov 10 '22 10:11 michaelhyatt

It is too hard to send all raw data (also not allowed). However,

What I can show you below; these are two applications sharing the same traceID, App1 is calling App2 in the same process.

image

Also you can see below; at the same time range, I am not able to see connection between them on Service Map

image

If you want to see anything more, just let me know.

alidrsn avatar Nov 11 '22 10:11 alidrsn

Which version of Elastic stack are you using? What are the configuration options you using for elastic.apm.*?

michaelhyatt avatar Nov 13 '22 02:11 michaelhyatt

The elastic version is 7.17 from Elastic Cloud. Therefore, there is no specific configuration for elastic.apm* It is simple as below

java -javaagent:/path/to/elastic-apm-agent-.jar
-Delastic.apm.service_name=my-application
-Delastic.apm.server_urls= "mykibana_URL"
-Delastic.apm.secret_token="MyTOKEN"
-Delastic.apm.environment=production
-Delastic.apm.application_packages=org.example
-jar my-application.jar

alidrsn avatar Nov 14 '22 23:11 alidrsn

Any chance you can share the sample app for me to test it on my end?

michaelhyatt avatar Nov 14 '22 23:11 michaelhyatt

Actually, I am not a MuleSoft expert. I am just gathering information from other departments. However, it should be too simple. 2 Mule app + 2 Elastic agent + 1 Http call

alidrsn avatar Nov 14 '22 23:11 alidrsn

No worries, do you know if it is a Mule domain app, or two standalone apps? Are they using Mule's HTTP client and listener? Also, what version of Mule runtime they are using?

michaelhyatt avatar Nov 15 '22 00:11 michaelhyatt

What I got from the team is " Two standalone apps, Mule HTTP listener to expose the interface and HTTP Request to make a request to Mule API. Mule 4 runtime "

alidrsn avatar Nov 15 '22 17:11 alidrsn

Both projects Mule 4? Mule 4 agent doesn't support distributed tracing.

BTW, this repo is for Mule 3 agent which does support it.

michaelhyatt avatar Nov 15 '22 22:11 michaelhyatt

Yes, they are both Mule 4. Therefore, I noticed that I created this issue on wrong agent (it should be apm-mule4-agent), sorry for that. However, still need to make it a little bit clear. I can see the transactions with same traceID, belong to two different services. If it is not supported, how can it be in this case ?

alidrsn avatar Nov 16 '22 09:11 alidrsn

It shouldn't be the case since there is no support for distributed tracing in the Mule4 agent. It will be good to get a hold of the sample app to test it locally, hard to troubleshoot simply based on images.

michaelhyatt avatar Nov 18 '22 00:11 michaelhyatt

Thanks for your help and time. I am looking forward to hear from you any update.

alidrsn avatar Nov 19 '22 00:11 alidrsn