nextflow
nextflow copied to clipboard
Use quiet output mode for hyperqueue executor
After doing some digging I found that hyperqueue does have a concept of "job state" vs task state, but it doesn't include the job state in the JSON output for hq job list
. However, the quiet output mode simply returns the id and state of each job. Additionally, submitting a job with quiet output mode simply returns the job id or an error if the submit failed.
Therefore, I changed the executor to use quiet mode for submitting jobs and checking job status. The parsing logic is much simpler and should scale much better because the hq commands now return the minimum required information.