otel-arrow icon indicating copy to clipboard operation
otel-arrow copied to clipboard

Optimize the OTel Arrow Producer API with regard to periodic gRPC reconnections

Open lquerel opened this issue 1 year ago • 0 comments

The OTel experimental Collector periodically closes and reopens every OTel Arrow stream to enhance load balancing. At present, each reconnection begins anew, not capitalizing on the insights gained from the previous connection regarding schema and dictionary. A minor modification to the API would allow it to capture the existing knowledge state (both schema and dictionaries), close the stream, and then reopen a new one, conveying the prior state. This approach would sidestep the majority of schema and dictionary rediscovery processes.

lquerel avatar Aug 22 '23 21:08 lquerel