Julian Samaroo
Julian Samaroo
The issue is primarily the cost of using Distributed workers, which don't use shared memory and thus incur a large overhead from data serialization (and is heavily reliant on the...
Very cool! Right now this API feels a bit cumbersome to me, so I'd like us to think on ways to make things feel "smoother" and more automatic (not that...
Sorry for the slow replies! > or go all in with caching, a CLI, ... like snakemake/nextflow (which would be a separate package I think), and that something in between...