opentelemetry-python-contrib icon indicating copy to clipboard operation
opentelemetry-python-contrib copied to clipboard

Disk buffering span exporter to avoid data loss (existing Java feature)

Open mfarzami opened this issue 8 months ago • 2 comments
trafficstars

What problem do you want to solve?

The current span exporter offerings may drop spans under high traffic if the buffer overflows.

Describe the solution you'd like

I am looking for a Python version of the disk buffering span exporters that were released in Java (https://github.com/open-telemetry/opentelemetry-java-contrib/tree/main/disk-buffering). These exporters store telemetry data in files which can be sent later on demand. There is a thread buffering the spans to a disk and a thread reading the spans from the disk.

Describe alternatives you've considered

Writing a custom span exporter that uses queueing/local storage to avoid overload, which would be complicated.

Additional Context

No response

Would you like to implement a fix?

None

mfarzami avatar Feb 25 '25 23:02 mfarzami