seb.

@michalkurka correct, not before images are built, and I'll probably change the latest Py or R versions if you agree. Mainly putting this to review also to discuss this version...

> would it be possible to apply the same refactoring/restructuring to the existing code base without changing the versions @michalkurka yes, that's what I tried to do at the end,...

We can definitely improve the error message with R frameworks. Note that the `run_cmd` function raises a `subprocess.CalledProcessError` if the subprocess failed, this error object has an `stderr` property that...

@PGijsbers do you confirm this is due to an old issue with `openml-python` and that there's nothing to fix on our side? or that it was fixed on our side...

Hi @paxcema, do you really get 3 dots in `.../venv/bin/pip: No such file or directory.` On which OS are you? from the `automlbenchmark` app folder, can you please run the...

sorry, wrong command, this one is closer to what is effectively done: ``` SHARED_DIR="$(cd $(dirname "frameworks/shared/setup.sh") && pwd -P)"; APP_ROOT=$(dirname $(dirname "$SHARED_DIR")); echo "shared=$SHARED_DIR"; echo "root=$APP_ROOT" ```

> I am trying to add a framework to the benchmark suite Ok, I guess you're not trying to add `TPOT` again, so I don't see why it's calling `amlb/frameworks/TPOT/setup.sh`....

> I also tried running python runbenchmark.py TPOT validation, and got the same error, which suggests the issue is not related to my setup.sh file. Sorry, I completely missed this...

Just tried with a blank docker container running Ubuntu 16.04. 1. I had to install `python3.7-dev`, because the default `python3` (3.5.2) is not enough for the app because of one...

@paxcema that's really weird. I'm working on macOS myself (10.15.5), and as you can imagine I regularly reinstall frameworks locally to test new versions, and I've never met this issue,...