unidist
unidist copied to clipboard
modin-project
Unified Distributed Execution
xref - https://github.com/modin-project/unidist/issues/342#issuecomment-1793727907
If we have 2 function calls A and B, such that B waits for completion of A as shown below ``` A = func1(args) B = func2(args) # logic in...
## What do these changes do? - [ ] first commit message and PR title follow format outlined [here](https://unidist.readthedocs.io/en/latest/developer/contributing.html#commit-message-formatting) > **_NOTE:_** If you edit the PR title to match this...
## What do these changes do? Improve task scheduler for MPI backend, Replaced the round robin algorithm to submit tasks, with a getting a worker rank with maximum data share....
## What do these changes do? - [ ] first commit message and PR title follow format outlined [here](https://unidist.readthedocs.io/en/latest/developer/contributing.html#commit-message-formatting) > **_NOTE:_** If you edit the PR title to match this...
## What do these changes do? - [ ] first commit message and PR title follow format outlined [here](https://unidist.readthedocs.io/en/latest/developer/contributing.html#commit-message-formatting) > **_NOTE:_** If you edit the PR title to match this...
## What do these changes do? - [ ] passes `flake8 .` - [ ] passes `black .` - [ ] signed commit with `git commit -s` - [ ]...
When sending data corresponding to a dataid from a host to other host we currently send data as the whole buffer. This currently crashes and is addresed in #376. As...
When running the following Modin tests on Open MPI the flow hangs both in CI and locally. ```bash MODIN_ENGINE=unidist mpiexec --oversubscribe -x UNIDIST_MPI_SHARED_OBJECT_STORE=True -n 1 python -m pytest modin/pandas/test/internals/test_benchmark_mode.py ```...