opentelemetry-collector-contrib icon indicating copy to clipboard operation
opentelemetry-collector-contrib copied to clipboard

[processor/transform] Tracing taking more CPU resources than expected

Open BinaryFissionGames opened this issue 5 months ago • 2 comments

Component(s)

processor/transform

What happened?

Description

Not sure if "bug" is the right label for this, but the tracing component for the transform processor seems to be taking a significant amount of process time in high throughput scenarios.

We had a report of high CPU usage on a collector (monitoring ~10k files), and we got a profile for it. One interesting insight to come out of the profile is that ~40% of the path for the transform processor was taken by tracer::Start.

Screenshot 2024-08-27 at 4 16 03 PM

That seems like a lot of resource spent there, and this is a scenario where the collector is not configured to emit traces at all, so this effectively does nothing. I'm wondering if this is something we can optimize? I haven't looked deep enough into it just yet to understand the pitfalls.

Collector version

0.104.0

Environment information

No response

OpenTelemetry Collector configuration

No response

Log output

No response

Additional context

No response

BinaryFissionGames avatar Aug 27 '24 20:08 BinaryFissionGames