flux-docs icon indicating copy to clipboard operation
flux-docs copied to clipboard

waiting-for-jobs: add new guide

Open chu11 opened this issue 2 years ago • 5 comments

Add a new guide on how to wait for jobs to complete.

chu11 avatar Mar 28 '23 04:03 chu11

pushed a fixup, tweaking a few things, adding a sentence here and there given comments above

chu11 avatar Mar 28 '23 05:03 chu11

Perhaps something should be said in here to the effect of: flux job wait implements semantics similar to wait(2) and waitpid(2) system calls or the wait POSIX shell command. It is much more efficient than flux job status, but can only be called once per waitable job since the wait status is "reaped", and it requires instance owner privileges.

If you need to wait for thousands of jobs efficiently, or need to wait for single jobs as they complete, then flux job wait with waitable jobs is probably the best solution.

grondo avatar Mar 28 '23 14:03 grondo

re-pushed. taking into account several of the comments above, re-worked the flow of the flux job wait section a bit.

chu11 avatar Mar 29 '23 05:03 chu11

re-pushed, updating example script given completion of https://github.com/flux-framework/flux-core/issues/5033

chu11 avatar Apr 01 '23 13:04 chu11

this should be updated to include flux watch

chu11 avatar May 15 '25 20:05 chu11