ImportError: cannot import name 'ensure_dir_exists'

[stenpiren]

After cloning the entire repository and doing docker-compose build and then docker-compose up I get I get the following Traceback:

Starting scotch_demo_julia_api_1 ... done Starting scotch_demo_python_api_1 ... done Starting scotch_demo_r_api_1 ... done Starting scotch_demo_notebook_1 ... done Attaching to scotch_demo_julia_api_1, scotch_demo_python_api_1, scotch_demo_notebook_1, scotch_demo_r_api_1 julia_api_1 | Traceback (most recent call last): julia_api_1 | File "/opt/conda/bin/jupyter-kernelgateway", line 7, in julia_api_1 | from kernel_gateway import launch_instance julia_api_1 | File "/opt/conda/lib/python3.5/site-packages/kernel_gateway/init.py", line 4, in julia_api_1 | from .gatewayapp import launch_instance julia_api_1 | File "/opt/conda/lib/python3.5/site-packages/kernel_gateway/gatewayapp.py", line 13, in julia_api_1 | from notebook.services.kernels.kernelmanager import MappingKernelManager julia_api_1 | File "/opt/conda/lib/python3.5/site-packages/notebook/init.py", line 25, in julia_api_1 | from .nbextensions import install_nbextension julia_api_1 | File "/opt/conda/lib/python3.5/site-packages/notebook/nbextensions.py", line 27, in julia_api_1 | from jupyter_core.utils import ensure_dir_exists julia_api_1 | ImportError: cannot import name 'ensure_dir_exists' notebook_1 | Traceback (most recent call last): notebook_1 | File "/opt/conda/bin/jupyter-notebook", line 7, in notebook_1 | from notebook.notebookapp import main notebook_1 | File "/opt/conda/lib/python3.5/site-packages/notebook/init.py", line 25, in notebook_1 | from .nbextensions import install_nbextension notebook_1 | File "/opt/conda/lib/python3.5/site-packages/notebook/nbextensions.py", line 27, in notebook_1 | from jupyter_core.utils import ensure_dir_exists notebook_1 | ImportError: cannot import name 'ensure_dir_exists' python_api_1 | Traceback (most recent call last): python_api_1 | File "/opt/conda/bin/jupyter-kernelgateway", line 7, in python_api_1 | from kernel_gateway import launch_instance python_api_1 | File "/opt/conda/lib/python3.5/site-packages/kernel_gateway/init.py", line 4, in python_api_1 | from .gatewayapp import launch_instance python_api_1 | File "/opt/conda/lib/python3.5/site-packages/kernel_gateway/gatewayapp.py", line 13, in python_api_1 | from notebook.services.kernels.kernelmanager import MappingKernelManager python_api_1 | File "/opt/conda/lib/python3.5/site-packages/notebook/init.py", line 25, in python_api_1 | from .nbextensions import install_nbextension python_api_1 | File "/opt/conda/lib/python3.5/site-packages/notebook/nbextensions.py", line 27, in python_api_1 | from jupyter_core.utils import ensure_dir_exists python_api_1 | ImportError: cannot import name 'ensure_dir_exists' r_api_1 | Traceback (most recent call last): r_api_1 | File "/opt/conda/bin/jupyter-kernelgateway", line 7, in r_api_1 | from kernel_gateway import launch_instance r_api_1 | File "/opt/conda/lib/python3.5/site-packages/kernel_gateway/init.py", line 4, in r_api_1 | from .gatewayapp import launch_instance r_api_1 | File "/opt/conda/lib/python3.5/site-packages/kernel_gateway/gatewayapp.py", line 13, in r_api_1 | from notebook.services.kernels.kernelmanager import MappingKernelManager r_api_1 | File "/opt/conda/lib/python3.5/site-packages/notebook/init.py", line 25, in r_api_1 | from .nbextensions import install_nbextension r_api_1 | File "/opt/conda/lib/python3.5/site-packages/notebook/nbextensions.py", line 27, in r_api_1 | from jupyter_core.utils import ensure_dir_exists r_api_1 | ImportError: cannot import name 'ensure_dir_exists' scotch_demo_julia_api_1 exited with code 1 scotch_demo_notebook_1 exited with code 1 scotch_demo_r_api_1 exited with code 1 scotch_demo_python_api_1 exited with code 1

Thus I am unable to start any of the APIs. Any clue how to solve this?

[kevin-bates]

This implies an update of jupyter_core is necessary.

Looks like Kernel Gateway's dependency on is jupyter_core>=4.0.0, when it should probably get updated to jupyter_core>=4.4.0

[stenpiren]

Hi @kevin-bates is the update to be done inside the docker image? I googled before opening the issue as "conda update jupyter_core jupyter_client" did not help solve the issue. Any other clues?

[stenpiren]

This is my updated jupyter and dependencies. Still it outputs same error.

[kevin-bates]

Hi @stenpiren - thanks for the update. I'm unfamiliar with the scotch_demo but, yes, the docker image is where the update is required. Looking at the Dockerfile, I believe the issue is probably due to the demo code pinning the source docker image to a specific tag: FROM jupyter/datascience-notebook:8015c88c4b11 which contains an older version of jupyter_core.

If you drop the tag portion of the FROM clause (e.g., FROM jupyter/datascience-notebook) then the latest datascience-notebook image will be used - which should have updated components. I'm not aware of anything that would preclude JKG from working with the latest image.

Please try that next - thanks.