flux-core
flux-core copied to clipboard
tracking issue: standby/preemptible jobs
From @ryanday36's list in #5165:
Preemptible jobs: AKA 'standby' qos / queue. Allow users to submit jobs that can be killed automatically by the system instance if another job needs the resources.
In some offline discussion, it was proposed that we could add a preemptible
(or similar) job submission flag for this purpose. Drawbacks to this approach:
- flags are currently not shared with the scheduler
- flags are not displayed in
flux jobs
output - flags cannot be updated from the command line
Most of those can be easily overcome if a submission flag is the correct approach.
Alternate solutions include:
- a jobspec attribute. In this case an initial solution could be accomplished in the scheduler alone. If a job has the preemptible attribute and the scheduler needs its resources for a higher priority job, then the scheduler could raise a job exception.
- As noted above, "standby" is often implemented as a queue. To do this in Flux might require some work on the queues interface, since this implies overlapping queues. The benefit of using a queue is that queue limits (and user/bank access) can be applied.