singularity icon indicating copy to clipboard operation
singularity copied to clipboard

Published 20 hours ago • verified publisher icon apptainer

Emit progress information during SIF creation

Open mikegray opened this issue 5 years ago • 8 comments

Version of Singularity:

3.0.3

Expected behavior

Some progress or update information during the creation of the SIF file.

Actual behavior

During "Creating SIF file..." step, the console does not produce any visible output for the user - but does create the resulting file eventually.

Steps to reproduce behavior

I was executing a few “larger” builds through the build service as I am testing a few things and I keep noticing that output freezes (temporarily) during INFO: Creating SIF file.... Is it possible to have some type of useful progress during that step? It appears to take awhile but is dependent on maybe the size of the SIF being created? @ikaneshiro mentioned maybe using the progress provided by mksquashfs.

mikegray avatar Jun 13 '19 14:06 mikegray

@mikegray We are currently not forwarding stdout of mksquashfs, so it is running silently in the background. I think we can forward that output through sylog so that a user can get more or less detail by using normal levels of verbosity e.g. -d,-s, etc

ikaneshiro avatar Jun 13 '19 14:06 ikaneshiro

Hi, I'm currently running into an issue where my build is seemingly hanging on "INFO: Creating SIF file..." for hours. Eventually, I have to quit the build, because I assume it froze. Builds previously took less than an hour before I switched from singularity 2 to 3. Having extra output here could be helpful.

mgroth0 avatar Jan 25 '21 00:01 mgroth0

I agree, it is very slow, so at least some output would be nice.

kyriakosschwarz avatar Feb 10 '21 10:02 kyriakosschwarz

Hello,

This is a templated response that is being sent out to all open issues. We are working hard on 'rebuilding' the Singularity community, and a major task on the agenda is finding out what issues are still outstanding.

Please consider the following:

  1. Is this issue a duplicate, or has it been fixed/implemented since being added?
  2. Is the issue still relevant to the current state of Singularity's functionality?
  3. Would you like to continue discussing this issue or feature request?

Thanks, Carter

carterpeel avatar May 15 '21 16:05 carterpeel

  1. Last I checked, this issue has not been fixed. I do not know if its a duplicate.
  2. It's relevant to improving the experiencing of building containers. More verbose log output helps you optimize builds and identify problems.
  3. @ikaneshiro's proposed solution is to forward makesquashfs output when user uses the -d or -s verbosity switches. I, and I'm sure the rest of the community, would greatly appreciate this!

mgroth0 avatar May 20 '21 19:05 mgroth0

I ran into this issue. And it's really frustrating to know especially on clusters.

vmiheer avatar Jul 02 '21 23:07 vmiheer

@mikegray We're looking into the issue carefully, soon will bring to community and discuss ways to better solve as well address this. Thankyou for keeping the interest in the subject.

pedroalvesbatista avatar Jul 15 '21 23:07 pedroalvesbatista

Also have the same problem with "large" builds. It'd be great to get a progress bar or some sort of info on the progress/process. On some builds, it hangs on the INFO: Creating SIF file... for a very long time. Eventually I run out of the time on the cluster job, so I haven't tried waiting longer (e.g. over 3 hrs)

urlicht avatar Oct 10 '21 01:10 urlicht

Pending issues from the old repo are moved to the new repo (https://github.com/apptainer/apptainer/issues/1391) and cleaned from the old, retired repo

kmuriki avatar Jun 06 '23 03:06 kmuriki