torchrunx icon indicating copy to clipboard operation
torchrunx copied to clipboard

Mirror behaviors seen in Python `multiprocessing`

Open apoorvkh opened this issue 1 year ago • 1 comments

There are certain behaviors in standard Python multiprocessing that we don't explicitly see in our library (although you could wrap launch() in such utilities).

For example: starting a "server" that runs in the background (#65), running launch() commands in parallel (e.g. evaluate 8 datasets in parallel on 8 GPUs) like a Pool, Pipes that would permit "yielding" objects from running processes (#54), and so forth.

apoorvkh avatar Nov 17 '24 18:11 apoorvkh

https://vereis.com/posts/disterl_inbox

apoorvkh avatar Dec 04 '24 00:12 apoorvkh