activitysim icon indicating copy to clipboard operation
activitysim copied to clipboard

SEMCOG model taking longer to run with 1.3 beta

Open aletzdy opened this issue 1 year ago • 3 comments

The SEMCOG model (10%, single processed) takes longer to run with the current 1.3 beta (main branch) than the official 1.2.2 version.

I already presented on this issue last month. Adding this issue here with further log files. Key models taking longer: workplace location, non-mandatory tour scheduling, tour mode choice, and trip destination.

activitysim_1.3beta.log

1.3 memory profile memory_profile

runtime comparison between 1.2 and 1.3 runtime_comparison

aletzdy avatar May 03 '24 15:05 aletzdy

Hi @aletzdy, do you have the activitysim.log from the equivalent 1.2 run?

i-am-sijia avatar May 03 '24 16:05 i-am-sijia

activitysim1.2.log

aletzdy avatar May 06 '24 13:05 aletzdy

Updating this issue regarding runtimes with and without Sharrow. Below is the runtime comparison of runs with following characteristics:

  • full sample,
  • multiporcess (20 cores),
  • max ram available 500Gb and,
  • run on Intel Xeon Platinum machine
  • Sharrow (blue) and non-sharrow (orange).

The runs were done last month using the main branch of ActivitySim, not camsys's sharrow-fix-all branch used for SANDAG example runs.

  • Total Sharrow runtime: 252mins
  • Total non-Sharrow runtime: 369mins

Workplace location is the main model taking noticeably longer under Sharrow.

image

aletzdy avatar Jun 20 '24 15:06 aletzdy