OpenCue icon indicating copy to clipboard operation
OpenCue copied to clipboard

Handle negative core requests

Open KernAttila opened this issue 2 years ago • 3 comments

Is your feature request related to a problem? Please describe. Our park is made of machines with different core count. We can't make dispatching rules based on a fixed number of cores to have only one job per machine, some machines will still pick up 2 jobs.

Describe the solution you'd like As in many render engines, we should be able to set a negative core requirement.

  • minCores=8 > reserve 8 cores
  • minCores=0 > reserve all cores
  • minCores=-2 > reserve all cores minus 2

Describe alternatives you've considered As an alternative, we can put hosts in different allocation groups according to their resources. But it makes handling jobs quite tedious.

KernAttila avatar Jun 02 '23 15:06 KernAttila

Can i try please??

Ashray-1501 avatar Aug 24 '23 13:08 Ashray-1501

Sure, I'll give you the proper branches to try it out when I'm back home tonight. You'll need to build cuebot and use my updated cuesubmit branch to test it out. So far we've been successful with this implementation

KernAttila avatar Aug 24 '23 14:08 KernAttila

You will need to build cuebot against this branch : https://github.com/Wolf-Pipeline/OpenCue/tree/cuebot-reserve-all-cores instructions here: https://www.opencue.io/docs/getting-started/deploying-cuebot/#option-4-build-from-source

And pull this branch to run cuebot + cuesubmit : https://github.com/Wolf-Pipeline/OpenCue/tree/cuesubmit-dev

Let me know if you need some assistance.

KernAttila avatar Aug 25 '23 09:08 KernAttila