MCDC icon indicating copy to clipboard operation
MCDC copied to clipboard
verified publisher icon CEMeNT-PSAAP

`cache` issues

Open jpmorgan98 opened this issue 1 year ago • 4 comments

Unknown behaviors and bugs of new cache feature

  • cache work flows before sending to MPI ranks
  • Size of saved cache growing unbounded
  • cache requiring recompilation for altered meshes, census time, and census bank buffer

jpmorgan98 avatar Feb 21 '24 20:02 jpmorgan98

After running in Numba mode and getting the compilation cached, we sometimes want to run in pure Python mode again (e.g., to do Python profiling, to compare Python and Numba error messages, etc). Currently, it seems that cached compilation will be used even if we run in Python mode. Is it possible to bypass or ignore the cached compilation in pure Python mode? @jpmorgan98

ilhamv avatar Feb 23 '24 13:02 ilhamv

This is very odd behavior. Like even if it's in Python mode it will run as if in Numba? My only thought is to delete the cache folder all together. It should be in /__pycache__ in your execution directory

jpmorgan98 avatar Feb 29 '24 00:02 jpmorgan98

It is found that, since we only put the cache decorator in the loop.py, if we make changes in kernel.py, the cache will not recompile.

ilhamv avatar Mar 05 '24 07:03 ilhamv

Has this been resolved, @braxtoncuneo @jpmorgan98 ? Do we need to document the new caching mechanism? Also, is it possible to add a regression test to check if the new caching options (--caching, etc.) work? Do we have the documentation on how to use the new caching options?

ilhamv avatar Feb 10 '25 04:02 ilhamv