Chris Roat

My workers and tasks do have resource constraints. In this case, I have 6 CPUs and 45 GB of memory -- and this particular task requests 45 GB. Would the...

I pushed a docker image to our cluster with 96d4fd43682c379f9b39b6dc55f568872b766a47 and it didn't seem to make a difference.

I reported this at 2021.12.0, and even later at 96d4fd4. In both cases, I'm seeing this behavior. I've attached the scheduler/worker dumps if that helps understand what is happening.

Could the needs_info label be removed? I reported this at the release requested. I am starting to try and understand these large cluster dump files, and would appreciate any tips....

Yes, thank you!

This is a very nice, minimally invasive solution to a very common problem. Please do consider it.

The CI failures are due to problems building wheels for dependencies of s3fs and gcsfs. I believe this will require updates to the datajoint/pydev image to include additional dev packages.

As per my comments above, I believe these failures need `apk add musl-dev` in `datajoint/pydev` in order to succeed. If you'd like to move forward with this, we can work...

Yes, fsspec is python only (AFAIK). It actually doesn't seem to have any dependencies, as it is really just a specification. There can be extra packages, depending on which underlying...

Is there still interest in this?