cms-bot icon indicating copy to clipboard operation
cms-bot copied to clipboard

Add resources-diff.py. Run script on FastTimerService resources.json output of PR versus IB release.

Open gartung opened this issue 1 year ago • 30 comments

gartung avatar Sep 25 '24 15:09 gartung

A new Pull Request was created by @gartung for branch master.

@aandvalenzuela, @cmsbuild, @iarspider, @smuzaffar can you please review it and eventually sign? Thanks. @antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this. cms-bot commands are listed here

cmsbuild avatar Sep 25 '24 15:09 cmsbuild

cms-bot internal usage

cmsbuild avatar Sep 25 '24 15:09 cmsbuild

Pull request #2343 was updated.

cmsbuild avatar Sep 25 '24 15:09 cmsbuild

enable profiling

gartung avatar Sep 25 '24 15:09 gartung

please test

gartung avatar Sep 25 '24 15:09 gartung

Pull request #2343 was updated.

cmsbuild avatar Sep 25 '24 15:09 cmsbuild

please test

gartung avatar Sep 25 '24 15:09 gartung

Pull request #2343 was updated.

cmsbuild avatar Sep 25 '24 20:09 cmsbuild

please test

gartung avatar Sep 25 '24 21:09 gartung

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-8e18c1/41754/summary.html COMMIT: e9611548920861a44920a6840c561b142da94fb2 CMSSW: CMSSW_14_2_X_2024-09-25-1100/el8_amd64_gcc12 Additional Tests: PROFILING User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cms-bot/2343/41754/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

cmsbuild avatar Sep 26 '24 00:09 cmsbuild

Pull request #2343 was updated.

cmsbuild avatar Sep 26 '24 01:09 cmsbuild

please test

gartung avatar Sep 26 '24 01:09 gartung

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-8e18c1/41755/summary.html COMMIT: 629e538991dcb9163ae1fad8a72e791782183033 CMSSW: CMSSW_14_2_X_2024-09-25-1100/el8_amd64_gcc12 Additional Tests: PROFILING User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cms-bot/2343/41755/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 143 differences found in the comparisons
  • DQMHistoTests: Total files compared: 44
  • DQMHistoTests: Total histograms compared: 3331342
  • DQMHistoTests: Total failures: 5916
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3325406
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 43 files compared)
  • Checked 193 log files, 163 edm output root files, 44 DQM output files
  • TriggerResults: no differences found

cmsbuild avatar Sep 26 '24 04:09 cmsbuild

Pull request #2343 was updated.

cmsbuild avatar Sep 26 '24 13:09 cmsbuild

please test

gartung avatar Sep 26 '24 14:09 gartung

Pull request #2343 was updated.

cmsbuild avatar Sep 26 '24 15:09 cmsbuild

please test

gartung avatar Sep 26 '24 15:09 gartung

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-8e18c1/41770/summary.html COMMIT: 2080451bd58bc8e2f34a68bf1499962da4e82d2a CMSSW: CMSSW_14_2_X_2024-09-26-1100/el8_amd64_gcc12 Additional Tests: PROFILING User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cms-bot/2343/41770/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

cmsbuild avatar Sep 26 '24 18:09 cmsbuild

Pull request #2343 was updated.

cmsbuild avatar Sep 26 '24 18:09 cmsbuild

please test

gartung avatar Sep 26 '24 18:09 gartung

Pull request #2343 was updated.

cmsbuild avatar Sep 26 '24 20:09 cmsbuild

Pull request #2343 was updated.

cmsbuild avatar Sep 26 '24 20:09 cmsbuild

please test

gartung avatar Sep 26 '24 20:09 gartung

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-8e18c1/41777/summary.html COMMIT: 32492c1e1a0fa9965ac83120f22a14b59edca2ed CMSSW: CMSSW_14_2_X_2024-09-26-1100/el8_amd64_gcc12 Additional Tests: PROFILING User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cms-bot/2343/41777/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • You potentially added 2 lines to the logs
  • Reco comparison results: 2 differences found in the comparisons
  • DQMHistoTests: Total files compared: 44
  • DQMHistoTests: Total histograms compared: 3331342
  • DQMHistoTests: Total failures: 3
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3331319
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 43 files compared)
  • Checked 193 log files, 163 edm output root files, 44 DQM output files
  • TriggerResults: no differences found

cmsbuild avatar Sep 26 '24 23:09 cmsbuild

Pull request #2343 was updated.

cmsbuild avatar Sep 27 '24 20:09 cmsbuild

please test

gartung avatar Sep 27 '24 20:09 gartung

Pull request #2343 was updated.

cmsbuild avatar Sep 27 '24 20:09 cmsbuild

Pull request #2343 was updated.

cmsbuild avatar Sep 27 '24 20:09 cmsbuild

please test

gartung avatar Sep 27 '24 20:09 gartung

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-8e18c1/41795/summary.html COMMIT: 5c0a32dcd4a40980b898bb26089cb38829a6922a CMSSW: CMSSW_14_2_X_2024-09-27-1100/el8_amd64_gcc12 Additional Tests: PROFILING User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cms-bot/2343/41795/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 44
  • DQMHistoTests: Total histograms compared: 3331342
  • DQMHistoTests: Total failures: 205
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3331117
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 43 files compared)
  • Checked 193 log files, 163 edm output root files, 44 DQM output files
  • TriggerResults: no differences found

cmsbuild avatar Sep 27 '24 23:09 cmsbuild