parsec icon indicating copy to clipboard operation
parsec copied to clipboard

Add a function to pre-set infos for all streams/devices/...

Open therault opened this issue 6 months ago • 0 comments

Lazy/dynamic allocation of infos can be convenient for the users, but also detrimental to predictive behaviors. Examples of drawbacks are when testing memory constrained setups (e.g., when the test uses zone_malloc to dynamically allocate objects in the info object constructor, that may fail nondeterministically because it depends how many streams call the constructor), or small scale performance runs where the number of cublas objects to initialize vary depending on the run. Calling the new function incurs deterministic overheads.

therault avatar Aug 07 '24 14:08 therault