Matt Rasmussen

Hi @hamr thanks for posting this question. It does appear we haven't fully documented this case. We'll add that. In the meantime here is how you configure the `Scheduler` to...

Thanks for submitting this issue. Usually a tempdir is not needed when running inside a Docker container, since the container provides isolation already. Do you have a case where you...

Thanks @spitz-dan-l for sharing this use case. Creating two executors is the currently support way to do this. However, creating a new task-level option for code_packaging should not be hard...

Hi @jshleap! Thanks for the question. I don't believe we set memory limits on local executors. Are you getting some behavior that suggests otherwise? > reserve memory even in local...

`max_workers` will work to limit parallelism across all tasks. If its just one task that should have parallelism limits, check out the `limits` config option: https://insitro.github.io/redun/config.html?highlight=limit#limits

Thanks @multimeric for posting this issue. You are correct that we intend to add additional executors over time and HPC clusters is indeed an important use case. Piggy backing off...

Hi @jshleap, thanks for question. We currently support all the object storage systems provided by `fsspec`, which include GCS. As for compute, the executor design should allow many different backends...

Ah, great point. The Docker repository would need to be generalized as well. So far we've been prioritizing work as it comes up naturally in our own projects, but PRs...

Just to give an update here. Our docker uri can be any docker registry, so there isn't anything ECR specific. We also have generalized our File staging to support GCS...

You raise good points here. I have thought about how to support code-packaging of parent directories. I haven't come up great solutions at the moment, but raising this issue encourages...