flow icon indicating copy to clipboard operation
flow copied to clipboard

Integrate OTEL

Open norberttech opened this issue 1 year ago • 0 comments

Initially this task was about adding Logger to Flow, but I think we should go beyond that and integrate Flow with OpenTelemetry.

Things that I would start from:

  • measuring how many rows were processed in general
  • processing time of entire pipeline
  • maximum memory consumption of entire pipeline
  • trace the data flow and record which functions / transformers / pipelines are being used

norberttech avatar Jan 06 '25 16:01 norberttech