whitebox-tools icon indicating copy to clipboard operation
whitebox-tools copied to clipboard

Error unwrapping 'output' on HPC

Open cefect opened this issue 8 months ago • 0 comments

When running BreachDepressionsLeastCost via slurm I'm experiencing a perplexing failure:

#SBATCH --cpus-per-task=1
$wbt_exe --run="BreachDepressionsLeastCost" ... --max_procs=-1

fails with:

thread 'main' panicked at whitebox-tools-app/src/tools/hydro_analysis/breach_depressions_least_cost.rs:657:27:
Error unwrapping 'output'
stack backtrace:
   0:     0x14a3f0123332 - <unknown>

increasing the cpus:

#SBATCH --cpus-per-task=2
$wbt_exe --run="BreachDepressionsLeastCost" ... --max_procs=-1

succeeds

different tool with 1 cpu:

#SBATCH --cpus-per-task=1
$wbt_exe --run="AggregateRaster" ... --max_procs=1

succeeds

It seems BreachDepressionsLeastCost requires at least 2 cpus for slurm to handle (unlike AggregateRaster). Also the error message is useless.

Mostly this is an FYI as increasing the nodes is an easy workaround (although not ideal for large jobs).

Operating System: GNU/Linux Kernel Version: 5.14.0-362.18.1.el9_3.x86_64 CPU Information: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit

cefect avatar Jun 22 '24 09:06 cefect