bloqade-python icon indicating copy to clipboard operation
bloqade-python copied to clipboard

Potentially swap out `concurrent.futures` with `ray` for multiprocessing backend.

Open weinbe58 opened this issue 2 years ago • 0 comments

if using python's built in multiprocessing library or components built on that, e.g. concurrent you must wrap your parallel portions of code with if __name__ == "__main__": to try and protect against infinite forking of a process. we're currently going to be using this as a backend in #421.

While this isn't overly cumbersome I feel like we should explore the package ray for executing emulator tasks in parallel. Thanks to @Roger-luo for pointing this library out.

weinbe58 avatar Aug 29 '23 14:08 weinbe58