FeatureRequest: Multistream

Open jc211 opened this issue 2 years ago • 1 comments

I think the idea of a SyncedMultiStream would be a nice addition to warp. My understanding is that this enables quick fork and join strategies. An implementation from another NVIDIA repo is found here: https://github.com/NVlabs/tiny-cuda-nn/blob/28ca991f99b44d10387d73077c07ccfdd7f96275/include/tiny-cuda-nn/multi_stream.h

Aug 01 '23 01:08 jc211

Thanks @jc211, I hadn't seen this before - indeed looks like it could be a useful pattern. It seems to rely only on standard CUDA stream behaviors, so I think it should be possible to implement in terms of the current Warp stream and event APIs. @nvlukasz for viz.

Aug 02 '23 00:08 mmacklin