future.batchtools icon indicating copy to clipboard operation
future.batchtools copied to clipboard

Request: add support for preemption

Open tantrev opened this issue 6 years ago • 1 comments

For schedulers like SLURM, preemptible jobs are really nice. Many University computing resources have a lot of spare computing power for preemptible jobs and having functionality from future.batchtools to support them (and re-schedule them if anything went wrong) would be fantastic.

tantrev avatar Jul 19 '18 19:07 tantrev

Yes, I agree, that would be very useful.

Being able to relaunch futures, in general, is a feature request that others asked about. I've started a specific issue on this over at https://github.com/HenrikBengtsson/future/issues/205.

Do you know if the underlying batchtools package provides mechanisms for working with preemptible jobs? I think that would be needed/very useful in order to start thinking about how this can be supported. It'll also help in identifying the API for https://github.com/HenrikBengtsson/future/issues/205.

HenrikBengtsson avatar Jul 23 '18 10:07 HenrikBengtsson