scTriangulate icon indicating copy to clipboard operation
scTriangulate copied to clipboard

reduce memory usage for parallelization

Open frankligy opened this issue 2 years ago • 1 comments

https://github.com/Barski-lab/workflows/blob/master/tools/dockerfiles/scripts/sc_split_atac.py

instead of using pool, use shared_memory to reduce memory overhead

frankligy avatar Sep 15 '22 20:09 frankligy

also thinking about using dask for MPI across multiple cores

frankligy avatar Sep 16 '22 15:09 frankligy