parsec
parsec copied to clipboard
Fully asynchronous MPI backend
This is work I did for the SPMM benchmark in TTG. Problem is that many threads push active messages into the communication backend, getting stuck in MPI. The communication thread becomes the bottleneck. In this PR we spawn extra threads that extract messages from the network. Threads pushing messages into the communication backend put them into a queue that is handled by the communication thread.
Putting this out here so it's not lost. Could become a component but I don't have time to make the comm engine an MCA.