David Godlove

If you have a tool on your host system that can use the PMI standard to accomplish the wire-up process than yes, you can use that instead. Something like Slurm...

Sorry for the delay. The blog post is here. https://ciq.com/blog/a-new-approach-to-mpi-in-apptainer/

As far as your second question goes, I assume you have probably figured something out already, but just in case, it looks like something you will need to split out...

Are you able to push an image using the same command manually? I see this error message in your logs: ``` $ strace -f apptainer -d push sst.sif oras://${CI_REGISTRY_IMAGE}/${CI_PROJECT_NAME}:latest execve("/usr/local/bin/apptainer",...

I read https://github.com/apptainer/singularity/issues/5962 with interest. There is a lot of info there. Thanks. It seems to me that @gmkurtzer was asking in that thread if it is possible for you...

What is your current working directory when you execute these containers? Your `$PWD` is supposed to be automatically mounted into the container I think. Also, is the `APPTAINER_BINDPATH` env var...

It is my understanding that the starter program needs to set up a mount namespace and then creates the mount namespace for the unprivileged user. I believe this is necessary...

The only thing I can see on first glance is that you are missing a space between the `-B` and the argument. ``` singularity run -B$TMPDIR:$TMPDIR,"${WORK_DIR}":/mnt \ ``` Could that...

I situations like this where the error makes no sense I find that it is often useful to try to do the same thing in multiple different ways. Sometimes that...

Perhaps there is a bug with deepvariant that prevents it from parsing paths properly? Or perhaps the error message is misleading and the issue is actually that the file type...