Matti Kortelainen
Matti Kortelainen
I think I have a proper fix in #39245. At least it works with the "reproducer" in https://github.com/cms-sw/cmssw/issues/39064#issuecomment-1228755900 .
https://github.com/cms-sw/cmssw/pull/39245 converged. I also made backports to 12_4_X and 12_5_X in #39484 and #39485.
assign alca
I took a quick look on `/afs/cern.ch/work/r/rosma/public/Run356381/igreport_total.res` and I see the profile reports `MEM_TOTAL`, i.e. total memory allocations. `MEM_LIVE` (that shows the memory usage at a given time) would be...
One thing I noticed is the job is awfully slow under `igprof -mp ... cmsRunGlibC`. While restarting my memory profile after copying the input files for run 356615 (for the...
A `MEM_LIVE` profile (dumped at `postGlobalEndRun`) points to `GEMDQMHarvester::dqmEndLuminosityBlock()` taking 610 MB https://mkortela.web.cern.ch/mkortela/cgi-bin/navigator/issue38976/run356615/preEndRun.mem.356615/25 . Nearly all of that appears to be in `std::map`s in `GEMDQMHarvester::createTableWatchingSummary()` https://mkortela.web.cern.ch/mkortela/cgi-bin/navigator/issue38976/run356615/preEndRun.mem.356615/27. The maps are initialized...
FYI @cms-sw/gem-dpg-l2
> Are we missing something in the recipe? We followed https://twiki.cern.ch/twiki/bin/viewauth/CMS/RecoIntegration#Run_profiler_igprof @mmusich @sarafiorendi Was this the part of the recipe you followed for the MEM_LIVE profile? > ``` > igprof...