SourceXtractorPlusPlus
SourceXtractorPlusPlus copied to clipboard
ONNX does not run with slurm
Since we are using the ONNX runtime for the ML detection we suffer from a problem between ONNX and slurm: https://github.com/microsoft/onnxruntime/issues/10736
Some comments from Alejandro:
It seems to be C++ code http://www.xavierdupre.fr/app/onnxruntime/helpsphinx/api_summary.html#onnxruntime.SessionOptions.intra_op_num_threads It would have to be added here I guess https://github.com/astrorama/SourceXtractorPlusPlus/blob/2823f0c939a5464d4793994c71367c24b2aa32db/SEImplementation/src/lib/Common/OnnxModel.cpp#L23 Not sure how to expose that to the user of sourcextractor++, though, because there are a *lot* of options.
I stumbled again over this one, meaning I was wondering why a job did not start until I remembered this issue.
Shall we fix this one variable to 1 to have a solution for slurm and see how far we come?
Slurm is quite commonly used, and there seems to be no issue with other framewrorks such as SGE (used at SDC-DE).