iroh
iroh copied to clipboard
metrics: check performance of trace collector
We're starting to see OpenTelemetry trace error occurred. cannot send span to the batch span processor because the channel is full which is usually the result of performance limitations on the collector side.
This is one we're going to punt. The performance of the pipe itself should be fine for now and once we want to scale up, we should move to a more mature setup. The reason this was popping up is that we hammered requests programmatically, our batching is minimal, the DB behind it fell over a couple times.