slurm exempt runs

[crkrenn]

For dedicated application time (DAT) runs, we need a "#SLURM --qos=exempt" in the batchfile. Can this be added to maestrowf/maestrowf/interfaces/script/slurmscriptadapter.py, perhaps as a "qos: exempt" option?

Gratefully,

-Chris

[FrankD412]

So, out of curiosity -- what does the qos option actually control? While I do use SLURM, I don't use a lot of its features.

That said, there is a reservation entry that you can use in either the step itself or the batch settings. DATs usually come with a name if I recall. IS that different than the qos specification?

[crkrenn]

I did notice the reservation entry. It is my understanding that qos=exempt lets you break some limits like active jobs per user or active nodes per user when using a reservation. I can double check with our slurm team to get more detail.

[FrankD412]

@crkrenn -- Were you able to confirm the qos setting? I'm looking at the SLURM adapter currently, and it'd be easy to add the exempt setting to the header when a reservation is detected.

[crkrenn]

Frank,

I did not get a chance to test it, but you should be able to verify that it works correctly by using maestro to submit a job that you know won’t run and then use “checkjob” to verify that the qos is correct.

Gratefully,

-Chris

Chris Krenn Lawrence Livermore National Laboratory [email protected]mailto:[email protected] 925-423-8636

From: Francesco Di Natale [email protected] Reply-To: LLNL/maestrowf [email protected] Date: Wednesday, January 22, 2020 at 5:48 AM To: LLNL/maestrowf [email protected] Cc: Ckl [email protected], Mention [email protected] Subject: Re: [LLNL/maestrowf] slurm exempt runs (#200)

@crkrennhttps://github.com/crkrenn -- Were you able to confirm the qos setting? I'm looking at the SLURM adapter currently, and it'd be easy to add the exempt setting to the header when a reservation is detected.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/LLNL/maestrowf/issues/200?email_source=notifications&email_token=ABOJ5V624XN4X5MKER5R75DQ7BFC7A5CNFSM4I7TM2U2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEJTTOGI#issuecomment-577189657, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABOJ5VZWGYOVW7Y5MIMTQVTQ7BFC7ANCNFSM4I7TM2UQ.