clearml-agent icon indicating copy to clipboard operation
clearml-agent copied to clipboard

Missing an installed package (scipy)

Open agunapal opened this issue 5 years ago • 1 comments

trains-agent experiment run is missing one of the installed packages (scipy). Hence it aborts.

Please let me know in case you need more information

python3.6/site-packages/keras_preprocessing/image/affine_transformations.py", line 281, in apply_affine_transform raise ImportError('Image transformations require SciPy. ' ImportError: Image transformations require SciPy. Install SciPy.

agunapal avatar Mar 06 '20 00:03 agunapal

Hi @agunapal , this is somewhat similar to #8 #9

In short when executing your code "manually" inside a python (pip) environment , the trains package records all the environment dependencies (python packages and versions). Then you can clone the experiment in the UI (and if needed edit the packages, see Execution -> "Installed Packages"),

The trains-agent will take the "Installed packages" list, create a new virtual environment (every time you run the experiment) and install the requested packages into the newly created virtual environment, once done it will update back the experiment to contain all the packages used in the virtual environment (as opposed to the initial list that included only the directly imported packages). This behavior ensures:

  1. trains-agent will not ruin any existing environment on the host machine
  2. When cloning an already executed (by trains-agent) experiment, it will create an exact copy of the entire python environment.

Makes sense ?

bmartinn avatar Mar 06 '20 16:03 bmartinn