otel-arrow
otel-arrow copied to clipboard
open-telemetry
Protocol and libraries for sending and receiving OpenTelemetry data using Apache Arrow
**Describe the bug** We cannot distinguish Arrow and non-Arrow in the `obsreport` metrics, because both use the tag `otlp`. **Steps to reproduce** Using Arrow or not? Hard to tell.
For analysis purposes, it might be interesting to export outlier samples from a stream of traces. Examples of outliers include: - Uncommon attribute keys - Uncommon attribute values - Uncommon...
The current obfuscation process preserves the length of the original text but doesn't maintain the patterns commonly found in logs. Consider the following logs as an example: ``` 12:30:45 server...
The gRPC settings that we have not explored with regards to exporter and receiver performance are: - WriteBufferSize (exporter) - ReadBufferSize (receiver) - MaxConcurrentStreams (receiver) We suspect these defaults will...
Multivariate metrics already compress quite efficiently due to the grouping of duplicated attributes among metrics. Currently, each type of data point (sum, gauge, histogram, etc.) has a dedicated attribute table/record....
Logs that are unstructured (meaning log records with content entirely in a string format) can benefit from optimization techniques like those detailed in the paper "CLP: Efficient and Scalable Search...
The OTel experimental Collector periodically closes and reopens every OTel Arrow stream to enhance load balancing. At present, each reconnection begins anew, not capitalizing on the insights gained from the...
Currently, complex attributes are encoded using CBOR through an external dependency. By making a slight adjustment to the `pdata` library (protobuf serialization/deserialization support for AnyValue), it would be advantageous to...
At present, the sorted columns list for each Arrow record type is hardcoded. However, by designating this list as metadata within the Arrow Schema for each record, we pave the...
The exporterhelper features a batching function that can nearly replace the concurrent batch processor in this repository. This issue is to track the eventual removal of concurrent batch processor in...
Metadata
Owner
Metadata
Protocol and libraries for sending and receiving OpenTelemetry data using Apache Arrow