samza icon indicating copy to clipboard operation
samza copied to clipboard

SAMZA-2561: Add job features to MetricsHeader

Open PawasChhokra opened this issue 4 years ago • 1 comments

Issues: Currently, the MetricsHeader object emitted by the SamzaContainer does not exclude basic job level information. Changes: Added a few features of the job to be emitted by the MetricsHeader API Changes: With this change, the MetricsHeader class will emit other properties of the job like number of containers used, number of cores used, etc. Upgrade instructions: None Usage instructions: None Tests: Modified existing tests to work with this change.

PawasChhokra avatar Jul 21 '20 15:07 PawasChhokra

Since a majority of the parameters are derived from config, in the interest of easy future extensibility, it'd be better to simply emit the entire config object once, from DiagnosticsManager at container-startup. Similar for dependencies.

rmatharu-zz avatar Jul 24 '20 18:07 rmatharu-zz