Termination in colorectal_histology due to memory overflow

[nabenabe0928]

As mentioned in the title, colorectal_histology is terminated while both cifar10 and fashion-mnist work. It seems only colorectal_histology requires 16+GB RAM in loading the surrogate benchmark.

Environment:

• Ubuntu 18.04

$ conda create -n test-jahs python==3.8
$ pip install jahs-bench numpy ConfigSpace parzen_estimator

My code:

import os

import jahs_bench


DATA_DIR = f"{os.environ['HOME']}/tabular_benchmarks/jahs_bench_data/"


tasks = ["colorectal_histology", "cifar10", "fashion_mnist"]
benchmark = jahs_bench.Benchmark(task=tasks[0], download=False, save_dir=DATA_DIR)

config = benchmark.sample_config(random_state=42)
results = benchmark(config, nepochs=200)

print(config)
print(results)

Output (Termination happens only in colorectal_histology)

[00:22:56] WARNING: ../src/gbm/gbtree.cc:386: Loading from a raw memory buffer on CPU only machine.  Changing tree_method to hist.
[00:22:56] WARNING: ../src/learner.cc:223: No visible GPU is found, setting `gpu_id` to -1
[00:23:08] WARNING: ../src/gbm/gbtree.cc:386: Loading from a raw memory buffer on CPU only machine.  Changing tree_method to hist.
[00:23:08] WARNING: ../src/learner.cc:223: No visible GPU is found, setting `gpu_id` to -1
[00:23:12] WARNING: ../src/gbm/gbtree.cc:386: Loading from a raw memory buffer on CPU only machine.  Changing tree_method to hist.
[00:23:12] WARNING: ../src/learner.cc:223: No visible GPU is found, setting `gpu_id` to -1
[00:23:16] WARNING: ../src/gbm/gbtree.cc:386: Loading from a raw memory buffer on CPU only machine.  Changing tree_method to hist.
[00:23:16] WARNING: ../src/learner.cc:223: No visible GPU is found, setting `gpu_id` to -1
[00:23:25] WARNING: ../src/gbm/gbtree.cc:386: Loading from a raw memory buffer on CPU only machine.  Changing tree_method to hist.
[00:23:25] WARNING: ../src/learner.cc:223: No visible GPU is found, setting `gpu_id` to -1
Killed