sparklens icon indicating copy to clipboard operation
sparklens copied to clipboard

EventLoss analyzer for detecting event loss

Open mayurdb opened this issue 4 years ago • 0 comments

Loss of critical events like StageEnd, JobEnd, ExecutorAdded, etc leads to inaccurate reports. https://github.com/qubole/sparklens/issues/56 highlights this problem. We should write an EventLossDetector Analyzer which will detect the event loss and communicate to the user that the report might not be accurate or not show the report altogether.

mayurdb avatar May 27 '20 04:05 mayurdb