Jovian_archive icon indicating copy to clipboard operation
Jovian_archive copied to clipboard

Automate the detection and configuration of local and remote system resources

Open florianzwagemaker opened this issue 4 years ago • 0 comments

We can make sure there's a significant improvement in setup and configuration by automating the detection and configuration of both local and remote system resources.

Available cpu can be found with the following command: grep -c ^processor /proc/cpuinfo And available memory can be found with:

awk '$3=="kB"{$2=$2/1024^2;$3="GB";} 1' /proc/meminfo | column -t | grep MemTotal | awk '{print $2}'

Using these commands in the wrapper, either locally or in combination with drmaa/bsub allows us to view the available system resources and (if necessary) change the Jovian settings in order to best match the system.

florianzwagemaker avatar Mar 11 '20 08:03 florianzwagemaker