pinot icon indicating copy to clipboard operation
pinot copied to clipboard

[multi stage] Measure threadCpuTime metric (similar to existing engine) in the operators, aggregate and include in response

Open siddharthteotia opened this issue 3 years ago • 2 comments

In the current engine, we measure threadCpuTime metric at the BaseCombineOperator level. Aggregated metric is sent to servers and broker aggregates across servers and includes in query response stats. We need to do something similar (granularity etc to be discussed) in the multi-stage engine.

siddharthteotia avatar Sep 16 '22 17:09 siddharthteotia

good idea. we also had some feedback from the community on this. but the stats definition is the first to sort out.

walterddr avatar Sep 16 '22 17:09 walterddr

I agree. Measurement is probably ok but correct propagation, aggregation and reflecting at different stages is also something that needs to be thought about

siddharthteotia avatar Sep 16 '22 17:09 siddharthteotia