vscode-jupyter icon indicating copy to clipboard operation
vscode-jupyter copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Jupyter processes persist after closing VS-Code on Remote SSH

Open simon-bachhuber opened this issue 2 years ago • 14 comments

Applies To

  • [X] Notebooks (.ipynb files)
  • [ ] Interactive Window and/or Cell Scripts (.py files with #%% markers)

What happened?

VS Code does not seem to stop running jupyter kernels when restarting notebooks or even after closing VS Code. This over time 1-2 days leads to insane memory usage of 32 GB of Ram with nothing opened on my PC (other than htop).

I recently upgraded to Ubuntu 22 and i am unsure whether or not this was as big of an issue before.

I also recently added the Jupyter PowerToys extension and started manually stopping jupyter notebooks but this did not help.

VS Code Version

Version: 1.70.1 Commit: 6d9b74a70ca9c7733b29f0456fd8195364076dda Date: 2022-08-10T06:09:15.055Z Electron: 18.3.5 Chromium: 100.0.4896.160 Node.js: 16.13.2 V8: 10.0.139.17-electron.0 OS: Linux x64 5.14.0-1048-oem

Jupyter Extension Version

v2022.7.1102252217

Jupyter logs

Visual Studio Code (1.70.1, undefined, desktop)
Jupyter Extension Version: 2022.7.1102252217.
Python Extension Version: 2022.12.1.
Workspace folder /home/simon/Documents/PYTHON/rl_research/simbed
info 16:53:4.273: ZMQ install verified.
User belongs to experiment group 'jupyterTestcf'
User belongs to experiment group 'jupyterEnhancedDataViewer'
info 16:53:4.527: LSP Notebooks experiment is enabled
info 16:53:4.575: Experiment status for python is {"enabled":true,"optInto":[],"optOutFrom":[]}
error 16:53:4.713: Failed to get activated environment variables ourselves [Error: Command failed: conda activate simbed && echo 'e8b39361-0157-4923-80e1-22d70d46dee6' && python /home/simon/.vscode/extensions/ms-toolsai.jupyter-2022.7.1102252217/pythonFiles/printEnvVariables.py

CommandNotFoundError: Your shell has not been properly configured to use 'conda activate'.
To initialize your shell, run

    $ conda init <SHELL_NAME>

Currently supported shells are:
  - bash
  - fish
  - tcsh
  - xonsh
  - zsh
  - powershell

See 'conda init --help' for more information and options.

IMPORTANT: You may need to close and restart your shell after running 'conda init'.



	at ChildProcess.exithandler (node:child_process:406:12)
	at ChildProcess.emit (node:events:390:28)
	at maybeClose (node:internal/child_process:1064:16)
	at Socket.<anonymous> (node:internal/child_process:450:11)
	at Socket.emit (node:events:390:28)
	at Pipe.<anonymous> (node:net:687:12)] {
  killed: false,
  code: 1,
  signal: null,
  cmd: "conda activate simbed && echo 'e8b39361-0157-4923-80e1-22d70d46dee6' && python /home/simon/.vscode/extensions/ms-toolsai.jupyter-2022.7.1102252217/pythonFiles/printEnvVariables.py"
}
error 16:53:4.715: Execing shell command, Class name = g, completed in 120ms, has a falsy return value, Arg 1: "~/.vscode/extensions/ms-toolsai.jupyter-2022.7.1102252217/pythonFiles/printEnvVariables.py", Arg 2: "" [Error: Command failed: conda activate simbed && echo 'e8b39361-0157-4923-80e1-22d70d46dee6' && python /home/simon/.vscode/extensions/ms-toolsai.jupyter-2022.7.1102252217/pythonFiles/printEnvVariables.py

CommandNotFoundError: Your shell has not been properly configured to use 'conda activate'.
To initialize your shell, run

    $ conda init <SHELL_NAME>

Currently supported shells are:
  - bash
  - fish
  - tcsh
  - xonsh
  - zsh
  - powershell

See 'conda init --help' for more information and options.

IMPORTANT: You may need to close and restart your shell after running 'conda init'.



	at ChildProcess.exithandler (node:child_process:406:12)
	at ChildProcess.emit (node:events:390:28)
	at maybeClose (node:internal/child_process:1064:16)
	at Socket.<anonymous> (node:internal/child_process:450:11)
	at Socket.emit (node:events:390:28)
	at Pipe.<anonymous> (node:net:687:12)] {
  killed: false,
  code: 1,
  signal: null,
  cmd: "conda activate simbed && echo 'e8b39361-0157-4923-80e1-22d70d46dee6' && python /home/simon/.vscode/extensions/ms-toolsai.jupyter-2022.7.1102252217/pythonFiles/printEnvVariables.py"
}
info 16:53:5.241: Process Execution: > ~/miniforge3/envs/simbed/bin/python -m pip list
> ~/miniforge3/envs/simbed/bin/python -m pip list
info 16:53:28.860: Preferred Remote kernel for /home/simon/Documents/PYTHON/rl_research/simbed/matlab_engine.ipynb is undefined
info 16:53:28.861: Starting Jupyter Session id = 'startUsingPythonInterpreter:.jvsc74a57bd0604dff45da25a60b58291261dc7a03791595928e73c3bd388c1b538d9524c8be./home/simon/miniforge3/envs/simbed/python./home/simon/miniforge3/envs/simbed/python.-m#ipykernel_launcher' (Python Path: /home/simon/miniforge3/envs/simbed, EnvType: Conda, EnvName: 'simbed', Version: 3.9.13) for '/home/simon/Documents/PYTHON/rl_research/simbed/matlab_engine.ipynb' (disableUI=true)
info 16:53:28.862: Creating raw notebook for resource '/home/simon/Documents/PYTHON/rl_research/simbed/matlab_engine.ipynb'
info 16:53:28.862: Computing working directory for resource '/home/simon/Documents/PYTHON/rl_research/simbed/matlab_engine.ipynb'
info 16:53:28.964: Widget Message: Received IPyWidgetMessages.IPyWidgets_IsReadyRequest
info 16:53:28.984: Preferred Remote kernel for /home/simon/Documents/PYTHON/rl_research/simbed/matlab_engine.ipynb is undefined
info 16:53:28.984: Find preferred kernel for /home/simon/Documents/PYTHON/rl_research/simbed/matlab_engine.ipynb with metadata {"kernelspec":{"display_name":"Python 3.9.13 ('simbed')","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.9.13"},"orig_nbformat":4,"vscode":{"interpreter":{"hash":"604dff45da25a60b58291261dc7a03791595928e73c3bd388c1b538d9524c8be"}}} & preferred interpreter /home/simon/miniforge3/envs/simbed/bin/python
info 16:53:28.991: Preferred Remote kernel for /home/simon/Documents/PYTHON/rl_research/simbed/matlab_engine.ipynb is undefined
info 16:53:28.991: Preferred kernel .jvsc74a57bd0604dff45da25a60b58291261dc7a03791595928e73c3bd388c1b538d9524c8be./home/simon/miniforge3/envs/simbed/python./home/simon/miniforge3/envs/simbed/python.-m#ipykernel_launcher is exact match or top match for non python kernels, (false, [object Object], true, false)
info 16:53:28.992: PreferredConnection: .jvsc74a57bd0604dff45da25a60b58291261dc7a03791595928e73c3bd388c1b538d9524c8be./home/simon/miniforge3/envs/simbed/python./home/simon/miniforge3/envs/simbed/python.-m#ipykernel_launcher found for NotebookDocument: /home/simon/Documents/PYTHON/rl_research/simbed/matlab_engine.ipynb
info 16:53:28.994: Starting raw kernel 'simbed (Python 3.9.13)' for interpreter /home/simon/miniforge3/envs/simbed/bin/python
info 16:53:29.4: Kernel launching with ports 9000,9001,9002,9003,9004. Start port is 9000
info 16:53:29.45: API called from ms-toolsai.vscode-jupyter-powertoys
info 16:53:29.420: Process Execution: > ~/miniforge3/envs/simbed/bin/python -c "import ipykernel; print(ipykernel.__version__); print("5dc3a68c-e34e-4080-9c3e-2a532b2ccb4d"); print(ipykernel.__file__)"
> ~/miniforge3/envs/simbed/bin/python -c "import ipykernel; print(ipykernel.__version__); print("5dc3a68c-e34e-4080-9c3e-2a532b2ccb4d"); print(ipykernel.__file__)"
info 16:53:29.436: Process Execution: > ~/miniforge3/envs/simbed/bin/python -m ipykernel_launcher --ip=127.0.0.1 --stdin=9003 --control=9001 --hb=9000 --Session.signature_scheme="hmac-sha256" --Session.key=b"6d00455b-68c9-485a-bca4-463632dad74e" --shell=9002 --transport="tcp" --iopub=9004 --f=/home/simon/.local/share/jupyter/runtime/kernel-v2-502567v9z9B6apeQq3.json
> ~/miniforge3/envs/simbed/bin/python -m ipykernel_launcher --ip=127.0.0.1 --stdin=9003 --control=9001 --hb=9000 --Session.signature_scheme="hmac-sha256" --Session.key=b"6d00455b-68c9-485a-bca4-463632dad74e" --shell=9002 --transport="tcp" --iopub=9004 --f=/home/simon/.local/share/jupyter/runtime/kernel-v2-502567v9z9B6apeQq3.json
info 16:53:29.436: Process Execution: cwd: ~/Documents/PYTHON/rl_research/simbed
cwd: ~/Documents/PYTHON/rl_research/simbed
info 16:53:29.588: ipykernel version 6.15.1 for /home/simon/miniforge3/envs/simbed/bin/python
info 16:53:29.589: ipykernel location ~/miniforge3/envs/simbed/lib/python3.9/site-packages/ipykernel/__init__.py for /home/simon/miniforge3/envs/simbed/bin/python
warn 16:53:29.971: StdErr from Kernel Process /home/simon/miniforge3/envs/simbed/lib/python3.9/site-packages/traitlets/traitlets.py:2392: FutureWarning: Supporting extra quotes around strings is deprecated in traitlets 5.0. You can use 'hmac-sha256' instead of '"hmac-sha256"' if you require traitlets >=5.
  warn(

warn 16:53:29.971: StdErr from Kernel Process /home/simon/miniforge3/envs/simbed/lib/python3.9/site-packages/traitlets/traitlets.py:2346: FutureWarning: Supporting extra quotes around Bytes is deprecated in traitlets 5.0. Use '6d00455b-68c9-485a-bca4-463632dad74e' instead of 'b"6d00455b-68c9-485a-bca4-463632dad74e"'.
  warn(

info 16:53:29.983: Kernel Output: NOTE: When using the `ipython kernel` entry point, Ctrl-C will not work.

To exit, you will have to explicitly quit this process, by either sending
"quit" from a client, or using Ctrl-\ in UNIX-like environments.

To read more about this, see https://github.com/ipython/ipython/issues/2049


To connect another client to this kernel, use:
    --existing kernel-v2-502567v9z9B6apeQq3.json

info 16:53:30.114: Started kernel simbed (Python 3.9.13)., (Raw session started and connected)
info 16:53:30.116: Finished connecting 529b8c99-d0ab-43fa-b1e6-81d144ee9452
info 16:53:30.120: UpdateWorkingDirectoryAndPath in Kernel
info 16:53:30.120: Executing silently Code (idle) = import os\nimport sys\n%cd "//home/simon/Documents/PYTHON/rl_research/simbed"\nif os.getcwd() not in sy
info 16:53:30.269: Executing silently Code (completed) = import os\nimport sys\n%cd "//home/simon/Documents/PYTHON/rl_research/simbed"\nif os.getcwd() not in sy with 1 output(s)
info 16:53:30.270: Waiting for idle on (kernel): b9e5152f-4bf9-4382-8cd8-3a6ec860ff49 -> idle
info 16:53:30.270: Finished waiting for idle on (kernel): b9e5152f-4bf9-4382-8cd8-3a6ec860ff49 -> idle
info 16:53:30.290: Process Execution: > ~/miniforge3/envs/simbed/bin/python ~/.vscode/extensions/ms-toolsai.jupyter-2022.7.1102252217/pythonFiles/printJupyterDataDir.py
> ~/miniforge3/envs/simbed/bin/python ~/.vscode/extensions/ms-toolsai.jupyter-2022.7.1102252217/pythonFiles/printJupyterDataDir.py
info 16:53:30.485: Widget Message: Received IPyWidgets_kernelOptions in ScriptManager
info 16:53:30.490: Widget Message: Received IPyWidgetMessages.IPyWidgets_kernelOptions
info 16:53:30.490: Widget Message: data-base-url set to https://file%2B.vscode-resource.vscode-cdn.net/home/simon/.vscode/extensions/ms-toolsai.jupyter-2022.7.1102252217/tmp/scripts/27725c0c63943e13edca6fb92fdc87af10bb9fcf051f0bae8b510e59dcb97b76/jupyter
info 17:23:37.779: Preferred Remote kernel for /home/simon/Documents/PYTHON/rl_research/simbed/actor_critic_myself.ipynb is undefined
info 17:23:37.780: Starting Jupyter Session id = 'startUsingPythonInterpreter:.jvsc74a57bd0604dff45da25a60b58291261dc7a03791595928e73c3bd388c1b538d9524c8be./home/simon/miniforge3/envs/simbed/python./home/simon/miniforge3/envs/simbed/python.-m#ipykernel_launcher' (Python Path: /home/simon/miniforge3/envs/simbed, EnvType: Conda, EnvName: 'simbed', Version: 3.9.13) for '/home/simon/Documents/PYTHON/rl_research/simbed/actor_critic_myself.ipynb' (disableUI=true)
info 17:23:37.781: Creating raw notebook for resource '/home/simon/Documents/PYTHON/rl_research/simbed/actor_critic_myself.ipynb'
info 17:23:37.781: Computing working directory for resource '/home/simon/Documents/PYTHON/rl_research/simbed/actor_critic_myself.ipynb'
info 17:23:37.826: Preferred Remote kernel for /home/simon/Documents/PYTHON/rl_research/simbed/actor_critic_myself.ipynb is undefined
info 17:23:37.826: Find preferred kernel for /home/simon/Documents/PYTHON/rl_research/simbed/actor_critic_myself.ipynb with metadata {"kernelspec":{"display_name":"Python 3.9.13 ('simbed')","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.9.13"},"orig_nbformat":4,"vscode":{"interpreter":{"hash":"604dff45da25a60b58291261dc7a03791595928e73c3bd388c1b538d9524c8be"}}} & preferred interpreter /home/simon/miniforge3/envs/simbed/bin/python
info 17:23:37.837: Preferred Remote kernel for /home/simon/Documents/PYTHON/rl_research/simbed/actor_critic_myself.ipynb is undefined
info 17:23:37.837: Preferred kernel .jvsc74a57bd0604dff45da25a60b58291261dc7a03791595928e73c3bd388c1b538d9524c8be./home/simon/miniforge3/envs/simbed/python./home/simon/miniforge3/envs/simbed/python.-m#ipykernel_launcher is exact match or top match for non python kernels, (false, [object Object], true, false)
info 17:23:37.841: PreferredConnection: .jvsc74a57bd0604dff45da25a60b58291261dc7a03791595928e73c3bd388c1b538d9524c8be./home/simon/miniforge3/envs/simbed/python./home/simon/miniforge3/envs/simbed/python.-m#ipykernel_launcher found for NotebookDocument: /home/simon/Documents/PYTHON/rl_research/simbed/actor_critic_myself.ipynb
info 17:23:37.843: Starting raw kernel 'simbed (Python 3.9.13)' for interpreter /home/simon/miniforge3/envs/simbed/bin/python
info 17:23:37.869: Kernel launching with ports 9005,9006,9007,9008,9009. Start port is 9000
info 17:23:38.228: Process Execution: > ~/miniforge3/envs/simbed/bin/python -m pip list
> ~/miniforge3/envs/simbed/bin/python -m pip list
info 17:23:38.389: Process Execution: > ~/miniforge3/envs/simbed/bin/python -c "import ipykernel; print(ipykernel.__version__); print("5dc3a68c-e34e-4080-9c3e-2a532b2ccb4d"); print(ipykernel.__file__)"
> ~/miniforge3/envs/simbed/bin/python -c "import ipykernel; print(ipykernel.__version__); print("5dc3a68c-e34e-4080-9c3e-2a532b2ccb4d"); print(ipykernel.__file__)"
info 17:23:38.409: Process Execution: > ~/miniforge3/envs/simbed/bin/python -m ipykernel_launcher --ip=127.0.0.1 --stdin=9008 --control=9006 --hb=9005 --Session.signature_scheme="hmac-sha256" --Session.key=b"b1732384-7d9f-48cd-9485-63bbe6fd8e62" --shell=9007 --transport="tcp" --iopub=9009 --f=/home/simon/.local/share/jupyter/runtime/kernel-v2-502567d5p6Xg4u7RGE.json
> ~/miniforge3/envs/simbed/bin/python -m ipykernel_launcher --ip=127.0.0.1 --stdin=9008 --control=9006 --hb=9005 --Session.signature_scheme="hmac-sha256" --Session.key=b"b1732384-7d9f-48cd-9485-63bbe6fd8e62" --shell=9007 --transport="tcp" --iopub=9009 --f=/home/simon/.local/share/jupyter/runtime/kernel-v2-502567d5p6Xg4u7RGE.json
info 17:23:38.409: Process Execution: cwd: ~/Documents/PYTHON/rl_research/simbed
cwd: ~/Documents/PYTHON/rl_research/simbed
info 17:23:38.532: ipykernel version 6.15.1 for /home/simon/miniforge3/envs/simbed/bin/python
info 17:23:38.532: ipykernel location ~/miniforge3/envs/simbed/lib/python3.9/site-packages/ipykernel/__init__.py for /home/simon/miniforge3/envs/simbed/bin/python
warn 17:23:38.891: StdErr from Kernel Process /home/simon/miniforge3/envs/simbed/lib/python3.9/site-packages/traitlets/traitlets.py:2392: FutureWarning: Supporting extra quotes around strings is deprecated in traitlets 5.0. You can use 'hmac-sha256' instead of '"hmac-sha256"' if you require traitlets >=5.
  warn(

warn 17:23:38.891: StdErr from Kernel Process /home/simon/miniforge3/envs/simbed/lib/python3.9/site-packages/traitlets/traitlets.py:2346: FutureWarning: Supporting extra quotes around Bytes is deprecated in traitlets 5.0. Use 'b1732384-7d9f-48cd-9485-63bbe6fd8e62' instead of 'b"b1732384-7d9f-48cd-9485-63bbe6fd8e62"'.
  warn(

info 17:23:38.897: Kernel Output: NOTE: When using the `ipython kernel` entry point, Ctrl-C will not work.

To exit, you will have to explicitly quit this process, by either sending
"quit" from a client, or using Ctrl-\ in UNIX-like environments.

To read more about this, see https://github.com/ipython/ipython/issues/2049


To connect another client to this kernel, use:
    --existing kernel-v2-502567d5p6Xg4u7RGE.json

info 17:23:39.29: Started kernel simbed (Python 3.9.13)., (Raw session started and connected)
info 17:23:39.30: Finished connecting 529b8c99-d0ab-43fa-b1e6-81d144ee9452
info 17:23:39.33: UpdateWorkingDirectoryAndPath in Kernel
info 17:23:39.34: Executing silently Code (idle) = import os\nimport sys\n%cd "//home/simon/Documents/PYTHON/rl_research/simbed"\nif os.getcwd() not in sy
info 17:23:39.158: Executing silently Code (completed) = import os\nimport sys\n%cd "//home/simon/Documents/PYTHON/rl_research/simbed"\nif os.getcwd() not in sy with 1 output(s)
info 17:23:39.158: Waiting for idle on (kernel): 9a235e49-8b01-4841-8551-b581e60bcc7f -> idle
info 17:23:39.158: Finished waiting for idle on (kernel): 9a235e49-8b01-4841-8551-b581e60bcc7f -> idle
info 17:23:39.169: Widget Message: Received IPyWidgets_kernelOptions in ScriptManager
info 17:23:39.169: Widget Message: Received IPyWidgetMessages.IPyWidgets_kernelOptions
info 17:23:39.176: Widget Message: data-base-url set to https://file%2B.vscode-resource.vscode-cdn.net/home/simon/.vscode/extensions/ms-toolsai.jupyter-2022.7.1102252217/tmp/scripts/27725c0c63943e13edca6fb92fdc87af10bb9fcf051f0bae8b510e59dcb97b76/jupyter
info 17:23:41.454: Disposing kernel .jvsc74a57bd0604dff45da25a60b58291261dc7a03791595928e73c3bd388c1b538d9524c8be./home/simon/miniforge3/envs/simbed/python./home/simon/miniforge3/envs/simbed/python.-m#ipykernel_launcher for notebook /home/simon/Documents/PYTHON/rl_research/simbed/actor_critic_myself.ipynb due to selection of another kernel or closing of the notebook
info 17:23:41.454: Dispose Kernel '/home/simon/Documents/PYTHON/rl_research/simbed/actor_critic_myself.ipynb' associated with '/home/simon/Documents/PYTHON/rl_research/simbed/actor_critic_myself.ipynb'
info 17:24:5.605: Execute Cell 60 /home/simon/Documents/PYTHON/rl_research/simbed/matlab_engine.ipynb
info 17:24:6.261: Cancel all remaining cells true || Error || undefined
info 17:24:6.261: Cancel pending cells
info 17:24:6.261: Cell 60 executed with state Error
info 17:24:12.270: Execute Cell 60 /home/simon/Documents/PYTHON/rl_research/simbed/matlab_engine.ipynb
info 17:24:12.410: Cell 60 executed with state Success
info 17:24:15.600: Execute Cell 60 /home/simon/Documents/PYTHON/rl_research/simbed/matlab_engine.ipynb
info 17:24:15.673: Cell 60 executed with state Success
info 17:24:19.949: Execute Cell 61 /home/simon/Documents/PYTHON/rl_research/simbed/matlab_engine.ipynb

LOTS MORE ...

Coding Language and Runtime Version

Python 3.9.X

Language Extension Version (if applicable)

No response

Anaconda Version (if applicable)

4.11.0

Running Jupyter locally or remotely?

Local

Screenshot htop

Screenshot from 2022-08-23 10-34-50

simon-bachhuber avatar Aug 23 '22 08:08 simon-bachhuber

@SimiPixel Thanks for filing this issue, I can see two problems that you are running into, but lets first focus on the issue of processes not being killed. The other has to do with conda not having been setup (or at least thats what the extension thinks), we can focus on that later

Please could you:

  • Exit VS Code completely
  • Kill all of the above Python processes
  • Confirm everything has been killed
  • Open a notebook and run a cell
  • Verify the above process shows up in the terminal
  • Close VS Code
  • Does the process die or is it still hanging around?

If this still persists, please could you try installing VS Code Insiders and installing the pre-release version of the Jupyter extension into that version of VS Code. Note: You can install VSCode Insiders side by side with you stable version. With VS Code insiders you get daily updates, though they aren't technically considered as stable as the stable release.

DonJayamanne avatar Aug 24 '22 18:08 DonJayamanne

I can confirm that using the most recent version of stable the processes do hang around even after closing VSCode. In fact i can not even kill them, logging out and back in is the only to me known solution on how to get ride of them easily.

However, i can also confirm that this problem does not exist when using VSCode Insiders + Jupyter Pre-Release. Just in case you are interested. This is the jupyter-output-log when using VSCode Insiders.

Visual Studio Code - Insiders (1.71.0-insider, undefined, desktop)
Jupyter Extension Version: 2022.8.1002381050.
Python Extension Version: 2022.12.1.
Workspace folder /home/simon/Documents/PYTHON/xML/prototyping
info 9:30:22.390: ZMQ install verified.
User belongs to experiment group 'jupyterTest'
User belongs to experiment group 'jupyterEnhancedDataViewer'
info 9:30:22.631: Old kernelSpecs (created by Jupyter Extension) stored in directory /home/simon/.local/share/jupyter/kernels/__old_vscode_kernelspecs
info 9:30:22.640: LSP Notebooks experiment is enabled
error 9:30:22.657: getCondaFile, Class name = k, completed in 14ms, has a falsy return value [TypeError: e.file.toLowerCase is not a function
	at k.getCachedInformation (/home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:7:43133)
	at /home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:7:41265
	at k.getCondaFile (/home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:7:41451)
	at /home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:7:109495
	at t.tracing (/home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:7:133108)
	at i.value (/home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:7:109475)
	at f.activate (/home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:2:2392703)
	at /home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:17:184551
	at Array.map (<anonymous>)
	at c.activate (/home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:17:184526)
	at /home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:2:1793630]
error 9:30:22.659: getCondaVersion, Class name = k, completed in 16ms, has a falsy return value [TypeError: e.file.toLowerCase is not a function
	at k.getCachedInformation (/home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:7:43133)
	at /home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:7:40734
	at k.getCondaVersion (/home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:7:40895)
	at /home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:7:109495
	at t.tracing (/home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:7:133108)
	at i.value (/home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:7:109475)
	at f.activate (/home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:2:2392751)
	at /home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:17:184551
	at Array.map (<anonymous>)
	at c.activate (/home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:17:184526)
	at /home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/out/extension.node.js:2:1793630]
info 9:30:22.897: Process Execution: > jupyter notebook --version
> jupyter notebook --version
info 9:30:22.903: Process Execution: > jupyter lab --version
> jupyter lab --version
info 9:30:23.7: Experiment status for python is {"enabled":true,"optInto":[],"optOutFrom":[]}
info 9:30:23.225: Process Execution: > /usr/bin/python3 -m pip list
> /usr/bin/python3 -m pip list
info 9:30:23.247: Process Execution: > /usr/bin/python3 -c "import pip"
> /usr/bin/python3 -c "import pip"
info 9:30:23.734: Preferred Remote kernel for /home/simon/Documents/PYTHON/xML/prototyping/testing.ipynb is undefined
info 9:30:23.734: Find preferred kernel for /home/simon/Documents/PYTHON/xML/prototyping/testing.ipynb with metadata {"interpreter":{"hash":"31f2aee4e71d21fbe5cf8b01ff0e069b9275f58929596ceb00d14d90e3e16cd6"},"kernelspec":{"display_name":"Python 3.8.10 64-bit","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.8.12"},"orig_nbformat":4} & preferred interpreter /usr/bin/python3
info 9:30:23.742: Preferred Remote kernel for /home/simon/Documents/PYTHON/xML/prototyping/testing.ipynb is undefined
info 9:30:23.742: Preferred kernel .jvsc74a57bd031f2aee4e71d21fbe5cf8b01ff0e069b9275f58929596ceb00d14d90e3e16cd6./usr/bin/python3./usr/bin/python3.-m#ipykernel_launcher is exact match or top match for non python kernels, (false, [object Object], true, false)
info 9:30:23.743: PreferredConnection: .jvsc74a57bd031f2aee4e71d21fbe5cf8b01ff0e069b9275f58929596ceb00d14d90e3e16cd6./usr/bin/python3./usr/bin/python3.-m#ipykernel_launcher found for NotebookDocument: /home/simon/Documents/PYTHON/xML/prototyping/testing.ipynb
info 9:30:23.752: Preferred Remote kernel for /home/simon/Documents/PYTHON/xML/prototyping/testing.ipynb is undefined
info 9:30:23.891: Process Execution: > ~/miniforge3/envs/qmt/bin/python -m pip list
> ~/miniforge3/envs/qmt/bin/python -m pip list
info 9:30:25.723: Execute Cell 0 /home/simon/Documents/PYTHON/xML/prototyping/testing.ipynb
info 9:30:25.725: Starting Jupyter Session id = 'startUsingPythonInterpreter:.jvsc74a57bd0bc1fef3d508214b8f1247db5e7bd97fc13b0303e0da38e7fef444a06da229cd5./home/simon/miniforge3/envs/qmt/python./home/simon/miniforge3/envs/qmt/python.-m#ipykernel_launcher' (Python Path: /home/simon/miniforge3/envs/qmt, EnvType: Conda, EnvName: 'qmt', Version: 3.8.12) for '/home/simon/Documents/PYTHON/xML/prototyping/testing.ipynb' (disableUI=false)
info 9:30:25.726: Creating raw notebook for resource '/home/simon/Documents/PYTHON/xML/prototyping/testing.ipynb'
info 9:30:25.726: Computing working directory for resource '/home/simon/Documents/PYTHON/xML/prototyping/testing.ipynb'
info 9:30:25.728: Starting raw kernel 'qmt (Python 3.8.12)' for interpreter /home/simon/miniforge3/envs/qmt/bin/python
info 9:30:25.740: Process Execution: > ~/miniforge3/envs/qmt/bin/python -c "import ipykernel; print(ipykernel.__version__); print("5dc3a68c-e34e-4080-9c3e-2a532b2ccb4d"); print(ipykernel.__file__)"
> ~/miniforge3/envs/qmt/bin/python -c "import ipykernel; print(ipykernel.__version__); print("5dc3a68c-e34e-4080-9c3e-2a532b2ccb4d"); print(ipykernel.__file__)"
info 9:30:25.744: Kernel launching with ports 9000,9001,9002,9003,9004. Start port is 9000
info 9:30:25.776: Process Execution: > ~/miniforge3/envs/qmt/bin/python -m ipykernel_launcher --ip=127.0.0.1 --stdin=9003 --control=9001 --hb=9000 --Session.signature_scheme="hmac-sha256" --Session.key=b"f566b63b-2b35-4bde-ada5-519a2e8ca74c" --shell=9002 --transport="tcp" --iopub=9004 --f=/home/simon/.local/share/jupyter/runtime/kernel-v2-4251HJpqL5wWiIOl.json
> ~/miniforge3/envs/qmt/bin/python -m ipykernel_launcher --ip=127.0.0.1 --stdin=9003 --control=9001 --hb=9000 --Session.signature_scheme="hmac-sha256" --Session.key=b"f566b63b-2b35-4bde-ada5-519a2e8ca74c" --shell=9002 --transport="tcp" --iopub=9004 --f=/home/simon/.local/share/jupyter/runtime/kernel-v2-4251HJpqL5wWiIOl.json
info 9:30:25.776: Process Execution: cwd: ~/Documents/PYTHON/xML/prototyping
cwd: ~/Documents/PYTHON/xML/prototyping
info 9:30:25.927: ipykernel version 6.6.0 for /home/simon/miniforge3/envs/qmt/bin/python
info 9:30:25.928: ipykernel location ~/miniforge3/envs/qmt/lib/python3.8/site-packages/ipykernel/__init__.py for /home/simon/miniforge3/envs/qmt/bin/python
warn 9:30:26.321: StdErr from Kernel Process /home/simon/miniforge3/envs/qmt/lib/python3.8/site-packages/traitlets/traitlets.py:2202: FutureWarning: Supporting extra quotes around strings is deprecated in traitlets 5.0. You can use 'hmac-sha256' instead of '"hmac-sha256"' if you require traitlets >=5.
  warn(
/home/simon/miniforge3/envs/qmt/lib/python3.8/site-packages/traitlets/traitlets.py:2157: FutureWarning: Supporting extra quotes around Bytes is deprecated in traitlets 5.0. Use 'f566b63b-2b35-4bde-ada5-519a2e8ca74c' instead of 'b"f566b63b-2b35-4bde-ada5-519a2e8ca74c"'.
  warn(

info 9:30:26.329: Kernel Output: NOTE: When using the `ipython kernel` entry point, Ctrl-C will not work.

To exit, you will have to explicitly quit this process, by either sending
"quit" from a client, or using Ctrl-\ in UNIX-like environments.

To read more about this, see https://github.com/ipython/ipython/issues/2049


To connect another client to this kernel, use:
    --existing kernel-v2-4251HJpqL5wWiIOl.json

info 9:30:26.411: Started kernel qmt (Python 3.8.12)., (Raw session started and connected)
info 9:30:26.412: Finished connecting 968fe1dc-2c22-434b-98d3-8ae782d68973
info 9:30:26.415: UpdateWorkingDirectoryAndPath in Kernel
info 9:30:26.415: Executing silently Code (idle) = import os\nimport sys\n%cd "//home/simon/Documents/PYTHON/xML/prototyping"\nif os.getcwd() not in sys.p
info 9:30:26.983: Executing silently Code (completed) = import os\nimport sys\n%cd "//home/simon/Documents/PYTHON/xML/prototyping"\nif os.getcwd() not in sys.p with 1 output(s)
info 9:30:26.983: Waiting for idle on (kernel): e0a68ba6-78b3-4dfa-98e8-6753a1e36082 -> idle
info 9:30:26.983: Finished waiting for idle on (kernel): e0a68ba6-78b3-4dfa-98e8-6753a1e36082 -> idle
info 9:30:26.992: Process Execution: > ~/miniforge3/envs/qmt/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/pythonFiles/printJupyterDataDir.py
> ~/miniforge3/envs/qmt/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/pythonFiles/printJupyterDataDir.py
info 9:30:26.995: Widget Message: Received IPyWidgets_kernelOptions in ScriptManager
info 9:30:26.995: Widget Message: Received IPyWidgetMessages.IPyWidgets_kernelOptions
info 9:30:27.33: Widget Message: data-base-url set to https://file%2B.vscode-resource.vscode-cdn.net/home/simon/.vscode-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/tmp/scripts/c22380b0917c1ac66c603187971258b9347b5ea62801d22c5e882adbdc4aec5f/jupyter
info 9:30:27.37: Cancel all remaining cells true || Error || undefined
info 9:30:27.37: Cancel pending cells
info 9:30:27.38: Cell 0 executed with state Error
info 9:30:32.505: Execute Cell 1 /home/simon/Documents/PYTHON/xML/prototyping/testing.ipynb
info 9:30:32.629: Cell 1 executed with state Success

simon-bachhuber avatar Aug 25 '22 07:08 simon-bachhuber

Since this therefore seems fixed in the near future. I will just use Insiders till stable catches up. Thank you!

simon-bachhuber avatar Aug 25 '22 07:08 simon-bachhuber

Well, i spoke too soon. SSH-ing to a Workstation (Ubuntu 20) leads to the identical bug despite the use of Insiders + Pre-Release.

This is an example log from the workstation. What is somewhat odd is that it again says that conda is not set up but it works just fine.

Local Stable: Unhappy with conda, Process-bug Local Insiders: Happy with conda, No Process-bug Remote Insiders: Unhappy with conda, Process-bug

Visual Studio Code - Insiders (1.71.0-insider, ssh-remote, desktop)
Jupyter Extension Version: 2022.8.1002381050.
Python Extension Version: 2022.12.1.
Workspace folder /clibs/simon
info 13:7:1.903: ZMQ install verified.
User belongs to experiment group 'jupyterTest'
User belongs to experiment group 'jupyterEnhancedDataViewer'
info 13:7:2.234: Old kernelSpecs (created by Jupyter Extension) stored in directory /home/simon/.local/share/jupyter/kernels/__old_vscode_kernelspecs
info 13:7:2.249: LSP Notebooks experiment is enabled
info 13:7:3.41: Experiment status for python is {"enabled":true,"optInto":[],"optOutFrom":[]}
info 13:7:3.80: Preferred Remote kernel for /clibs/simon/simbed/actor_critic_myself.ipynb is undefined
info 13:7:3.80: Find preferred kernel for /clibs/simon/simbed/actor_critic_myself.ipynb with metadata {"kernelspec":{"display_name":"Python 3.9.13 ('simbed')","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.9.13"},"orig_nbformat":4,"vscode":{"interpreter":{"hash":"043dff6dfa37d76807ffa6ff43fcf097b462eccfbdb014405e7c9af6eb504a80"}}} & preferred interpreter /clibs/miniforge3/envs/simbed/bin/python
info 13:7:3.82: Preferred Remote kernel for /clibs/simon/simbed/actor_critic_myself.ipynb is undefined
info 13:7:3.82: Preferred kernel .jvsc74a57bd0043dff6dfa37d76807ffa6ff43fcf097b462eccfbdb014405e7c9af6eb504a80./clibs/miniforge3/envs/simbed/python./clibs/miniforge3/envs/simbed/python.-m#ipykernel_launcher is exact match or top match for non python kernels, (false, [object Object], true, false)
info 13:7:3.84: PreferredConnection: .jvsc74a57bd0043dff6dfa37d76807ffa6ff43fcf097b462eccfbdb014405e7c9af6eb504a80./clibs/miniforge3/envs/simbed/python./clibs/miniforge3/envs/simbed/python.-m#ipykernel_launcher found for NotebookDocument: /clibs/simon/simbed/actor_critic_myself.ipynb
error 13:7:3.278: Failed to get activated environment variables ourselves [Error: Command failed: conda activate simbed && echo 'e8b39361-0157-4923-80e1-22d70d46dee6' && python /clibs/.vscode-server-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/pythonFiles/printEnvVariables.py

CommandNotFoundError: Your shell has not been properly configured to use 'conda activate'.
To initialize your shell, run

    $ conda init <SHELL_NAME>

Currently supported shells are:
  - bash
  - fish
  - tcsh
  - xonsh
  - zsh
  - powershell

See 'conda init --help' for more information and options.

IMPORTANT: You may need to close and restart your shell after running 'conda init'.



	at ChildProcess.exithandler (node:child_process:399:12)
	at ChildProcess.emit (node:events:526:28)
	at maybeClose (node:internal/child_process:1092:16)
	at Process.ChildProcess._handle.onexit (node:internal/child_process:302:5)] {
  killed: false,
  code: 1,
  signal: null,
  cmd: "conda activate simbed && echo 'e8b39361-0157-4923-80e1-22d70d46dee6' && python /clibs/.vscode-server-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/pythonFiles/printEnvVariables.py"
}
error 13:7:3.280: Execing shell command, Class name = b, completed in 225ms, has a falsy return value, Arg 1: "conda activate simbed && echo 'e8b39361-0157-4923-80e1-22d70d46dee6' && python /clibs/.vscode-server-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/pythonFiles/printEnvVariables.py", Arg 2: "" [Error: Command failed: conda activate simbed && echo 'e8b39361-0157-4923-80e1-22d70d46dee6' && python /clibs/.vscode-server-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/pythonFiles/printEnvVariables.py

CommandNotFoundError: Your shell has not been properly configured to use 'conda activate'.
To initialize your shell, run

    $ conda init <SHELL_NAME>

Currently supported shells are:
  - bash
  - fish
  - tcsh
  - xonsh
  - zsh
  - powershell

See 'conda init --help' for more information and options.

IMPORTANT: You may need to close and restart your shell after running 'conda init'.



	at ChildProcess.exithandler (node:child_process:399:12)
	at ChildProcess.emit (node:events:526:28)
	at maybeClose (node:internal/child_process:1092:16)
	at Process.ChildProcess._handle.onexit (node:internal/child_process:302:5)] {
  killed: false,
  code: 1,
  signal: null,
  cmd: "conda activate simbed && echo 'e8b39361-0157-4923-80e1-22d70d46dee6' && python /clibs/.vscode-server-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/pythonFiles/printEnvVariables.py"
}
info 13:7:3.641: Preferred Remote kernel for /clibs/simon/simbed/actor_critic_myself.ipynb is undefined
info 13:7:4.356: Process Execution: > /clibs/miniforge3/envs/simbed/bin/python -m pip list
> /clibs/miniforge3/envs/simbed/bin/python -m pip list
info 13:7:13.956: Preferred Remote kernel for /clibs/simon/simbed/matlab_engine.ipynb is undefined
info 13:7:14.12: Preferred Remote kernel for /clibs/simon/simbed/matlab_engine.ipynb is undefined
info 13:7:14.13: Find preferred kernel for /clibs/simon/simbed/matlab_engine.ipynb with metadata {"kernelspec":{"display_name":"Python 3.9.13 ('simbed')","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.9.13"},"orig_nbformat":4,"vscode":{"interpreter":{"hash":"604dff45da25a60b58291261dc7a03791595928e73c3bd388c1b538d9524c8be"}}} & preferred interpreter /clibs/miniforge3/envs/simbed/bin/python
info 13:7:14.16: Preferred Remote kernel for /clibs/simon/simbed/matlab_engine.ipynb is undefined
info 13:7:14.16: Preferred kernel .jvsc74a57bd0043dff6dfa37d76807ffa6ff43fcf097b462eccfbdb014405e7c9af6eb504a80./clibs/miniforge3/envs/simbed/python./clibs/miniforge3/envs/simbed/python.-m#ipykernel_launcher is exact match or top match for non python kernels, (false, [object Object], false, false)
info 13:7:14.18: PreferredConnection: .jvsc74a57bd0043dff6dfa37d76807ffa6ff43fcf097b462eccfbdb014405e7c9af6eb504a80./clibs/miniforge3/envs/simbed/python./clibs/miniforge3/envs/simbed/python.-m#ipykernel_launcher found for NotebookDocument: /clibs/simon/simbed/matlab_engine.ipynb
error 13:7:16.774: Live Notebook not available for /clibs/simon/simbed/matlab_engine.ipynb
error 13:7:17.800: Live Notebook not available for /clibs/simon/simbed/matlab_engine.ipynb
info 13:7:18.497: Execute Cell 0 /clibs/simon/simbed/matlab_engine.ipynb
info 13:7:18.499: Starting Jupyter Session id = 'startUsingPythonInterpreter:.jvsc74a57bd0043dff6dfa37d76807ffa6ff43fcf097b462eccfbdb014405e7c9af6eb504a80./clibs/miniforge3/envs/simbed/python./clibs/miniforge3/envs/simbed/python.-m#ipykernel_launcher' (Python Path: /clibs/miniforge3/envs/simbed, EnvType: Conda, EnvName: 'simbed', Version: 3.9.13) for '/clibs/simon/simbed/matlab_engine.ipynb' (disableUI=false)
info 13:7:18.500: Creating raw notebook for resource '/clibs/simon/simbed/matlab_engine.ipynb'
info 13:7:18.500: Computing working directory for resource '/clibs/simon/simbed/matlab_engine.ipynb'
info 13:7:18.503: Starting raw kernel 'simbed (Python 3.9.13)' for interpreter /clibs/miniforge3/envs/simbed/bin/python
info 13:7:18.519: Kernel launching with ports 9000,9001,9002,9003,9004. Start port is 9000
info 13:7:19.497: Process Execution: > /clibs/miniforge3/envs/simbed/bin/python -c "import ipykernel; print(ipykernel.__version__); print("5dc3a68c-e34e-4080-9c3e-2a532b2ccb4d"); print(ipykernel.__file__)"
> /clibs/miniforge3/envs/simbed/bin/python -c "import ipykernel; print(ipykernel.__version__); print("5dc3a68c-e34e-4080-9c3e-2a532b2ccb4d"); print(ipykernel.__file__)"
info 13:7:19.544: Process Execution: > /clibs/miniforge3/envs/simbed/bin/python -m ipykernel_launcher --ip=127.0.0.1 --stdin=9003 --control=9001 --hb=9000 --Session.signature_scheme="hmac-sha256" --Session.key=b"768ef866-523b-4622-bb3a-08afe8f4587d" --shell=9002 --transport="tcp" --iopub=9004 --f=/home/rzlin/vy43meti/.local/share/jupyter/runtime/kernel-v2-34446n0YWh2BjPgbj.json
> /clibs/miniforge3/envs/simbed/bin/python -m ipykernel_launcher --ip=127.0.0.1 --stdin=9003 --control=9001 --hb=9000 --Session.signature_scheme="hmac-sha256" --Session.key=b"768ef866-523b-4622-bb3a-08afe8f4587d" --shell=9002 --transport="tcp" --iopub=9004 --f=/home/rzlin/vy43meti/.local/share/jupyter/runtime/kernel-v2-34446n0YWh2BjPgbj.json
info 13:7:19.544: Process Execution: cwd: /clibs/simon/simbed
cwd: /clibs/simon/simbed
info 13:7:19.642: ipykernel version 6.15.1 for /clibs/miniforge3/envs/simbed/bin/python
info 13:7:19.643: ipykernel location /clibs/miniforge3/envs/simbed/lib/python3.9/site-packages/ipykernel/__init__.py for /clibs/miniforge3/envs/simbed/bin/python
warn 13:7:19.983: StdErr from Kernel Process /clibs/miniforge3/envs/simbed/lib/python3.9/site-packages/traitlets/traitlets.py:2392: FutureWarning: Supporting extra quotes around strings is deprecated in traitlets 5.0. You can use 'hmac-sha256' instead of '"hmac-sha256"' if you require traitlets >=5.
  warn(

warn 13:7:19.983: StdErr from Kernel Process /clibs/miniforge3/envs/simbed/lib/python3.9/site-packages/traitlets/traitlets.py:2346: FutureWarning: Supporting extra quotes around Bytes is deprecated in traitlets 5.0. Use '768ef866-523b-4622-bb3a-08afe8f4587d' instead of 'b"768ef866-523b-4622-bb3a-08afe8f4587d"'.
  warn(

info 13:7:20.20: Kernel Output: NOTE: When using the `ipython kernel` entry point, Ctrl-C will not work.

To exit, you will have to explicitly quit this process, by either sending
"quit" from a client, or using Ctrl-\ in UNIX-like environments.

To read more about this, see https://github.com/ipython/ipython/issues/2049


To connect another client to this kernel, use:
    --existing kernel-v2-34446n0YWh2BjPgbj.json

info 13:7:20.201: Started kernel simbed (Python 3.9.13)., (Raw session started and connected)
info 13:7:20.201: Finished connecting 6aed3d61-c7a4-4a62-a955-4e44c0a42bad
info 13:7:20.207: UpdateWorkingDirectoryAndPath in Kernel
info 13:7:20.208: Executing silently Code (busy) = import os\nimport sys\n%cd "//clibs/simon/simbed"\nif os.getcwd() not in sys.path:\nsys.path.insert(
info 13:7:20.344: Executing silently Code (completed) = import os\nimport sys\n%cd "//clibs/simon/simbed"\nif os.getcwd() not in sys.path:\nsys.path.insert( with 1 output(s)
info 13:7:20.344: Waiting for idle on (kernel): af9ba625-b0a3-4e25-8a3e-5234423b30a1 -> idle
info 13:7:20.344: Finished waiting for idle on (kernel): af9ba625-b0a3-4e25-8a3e-5234423b30a1 -> idle
info 13:7:20.364: Process Execution: > /clibs/miniforge3/envs/simbed/bin/python /clibs/.vscode-server-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/pythonFiles/printJupyterDataDir.py
> /clibs/miniforge3/envs/simbed/bin/python /clibs/.vscode-server-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/pythonFiles/printJupyterDataDir.py
info 13:7:20.386: Widget Message: Received IPyWidgets_kernelOptions in ScriptManager
info 13:7:20.391: Widget Message: Received IPyWidgetMessages.IPyWidgets_kernelOptions
info 13:7:20.426: Widget Message: data-base-url set to https://vscode-remote%2Bssh-002dremote-002bws.vscode-resource.vscode-cdn.net/clibs/.vscode-server-insiders/extensions/ms-toolsai.jupyter-2022.8.1002381050/tmp/scripts/40ee95752db98f0eef8e706d3247480fc89bff4986d79a04b757c6cb7513cfaa/jupyter
info 13:7:20.951: Cell 0 executed with state Success

Finally, these are two screenshots after the connection has been closed to the workstation and re-connected directly via terminal. Screenshot from 2022-08-25 11-21-26 Screenshot from 2022-08-25 11-21-40

simon-bachhuber avatar Aug 25 '22 09:08 simon-bachhuber

Unhappy with conda,

Please could you file a separate bug for the above issue. I'd like to take a look at that as well, but seprately, else it gets too confusing when we look at multiple problems in the same issue.

Remote Insiders: Unhappy with conda, Process-bug

I'm going to rename the title of this extension to reflect the fact that this issue now only persists on remote SSH

DonJayamanne avatar Aug 25 '22 10:08 DonJayamanne

@SimiPixel Thanks for the screenshot, a few questions.

  • Is that showing the number of Pyhton processes running? Looks like in excess of 20 of them, is that correct?
    • I don't quite understand how so many of them could have started, he only hypothesis I have is, that they have been started via some code in the kernel. Are you running some special code that ends up creating these n python processes?
  • Next, please open VS Code on that remote machine (as you have already done), then run your code that ends up generating these python processes.
    • Instead of exiting VS Code, please could you instead close the Interactive Windows and all Notebooks.
    • I.e. close all files in VS Code, and then check if the Python processes have been killed (one might remain, that's used to interrupt kernels),
    • Let me know if they all get killed (except for one), when closing the files in VS Code

DonJayamanne avatar Aug 25 '22 10:08 DonJayamanne

Is that showing the number of Pyhton processes running? Looks like in excess of 20 of them, is that correct? I don't quite understand how so many of them could have started, he only hypothesis I have is, that they have been started via some code in the kernel. Are you running some special code that ends up creating these n python processes?

I realised that it might also show threads. I am switching to ps -aux for now.

It is dependent on the code i run in the cell. Using only a print-statement i can not reproduce the bug.

However, with specific code i can create the following: After Connecting to Remote but before opening notebook.

vy43meti  102684  0.0  0.0   2624   536 ?        S    15:03   0:00 sh /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61ed4/bin/code-server-insiders --start-server --host=127.0.0.
vy43meti  102694  2.2  0.1 945960 117404 ?       Sl   15:03   0:04 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61ed4/node /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08
vy43meti  102736  0.2  0.0 707164 49476 ?        Sl   15:03   0:00 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61ed4/node /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08
root      102907  0.0  0.0      0     0 ?        I    15:03   0:00 [kworker/0:0-events]
root      102924  0.0  0.0  52160 13756 ?        Ss   15:03   0:00 sshd: vy43meti [priv]
vy43meti  103105  0.0  0.0  52416  7472 ?        S    15:03   0:00 sshd: vy43meti@notty
vy43meti  103106  0.0  0.0  18332  3856 ?        Ss   15:03   0:00 -bash
vy43meti  103118  0.0  0.0  10388  4200 ?        S    15:03   0:00 bash
vy43meti  103169  5.4  0.2 1018580 167724 ?      Sl   15:03   0:10 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61ed4/node /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08
vy43meti  103180  0.2  0.1 769968 68568 ?        Sl   15:03   0:00 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61ed4/node /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08
vy43meti  103315  7.6  0.6 1143648 409344 ?      Sl   15:03   0:14 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61ed4/node /clibs/.vscode-server-insiders/extensions/ms-python.v
vy43meti  103324  0.0  0.0 590228 40540 ?        Sl   15:03   0:00 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61ed4/node /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08

Right after running a cell with lots of code

vy43meti  102684  0.0  0.0   2624   536 ?        S    15:03   0:00 sh /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61ed4/bin/code-server-insiders --start-server --host=127.0.0.
vy43meti  102694  1.0  0.1 941560 81860 ?        Sl   15:03   0:09 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61ed4/node /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08
vy43meti  102736  0.1  0.0 716588 51992 ?        Sl   15:03   0:01 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61ed4/node /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08
root      102924  0.0  0.0  52160 13756 ?        Ss   15:03   0:00 sshd: vy43meti [priv]
vy43meti  103105  0.1  0.0  52416  7648 ?        S    15:03   0:01 sshd: vy43meti@notty
vy43meti  103106  0.0  0.0  18332  3856 ?        Ss   15:03   0:00 -bash
vy43meti  103118  0.0  0.0  10388  4200 ?        S    15:03   0:00 bash
vy43meti  103169  5.4  0.3 1185492 222456 ?      Sl   15:03   0:47 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61ed4/node /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08
vy43meti  103180  0.0  0.1 901040 68568 ?        Sl   15:03   0:00 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61ed4/node /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08
vy43meti  103315 13.5  1.1 1517900 756708 ?      Sl   15:03   1:56 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61ed4/node /clibs/.vscode-server-insiders/extensions/ms-python.v
vy43meti  103324  0.0  0.0 590228 40540 ?        Sl   15:03   0:00 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61ed4/node /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08
root      103808  0.0  0.0      0     0 ?        I    15:05   0:00 [kworker/6:2-mm_percpu_wq]
root      104447  0.0  0.0      0     0 ?        I    15:06   0:00 [kworker/14:0]
root      104460  0.0  0.0      0     0 ?        I    15:06   0:00 [kworker/4:2-mm_percpu_wq]
root      104842  0.0  0.0      0     0 ?        I    15:07   0:00 [kworker/2:2]
root      105530  0.0  0.0      0     0 ?        I    15:09   0:00 [kworker/1:0-events]
root      105875  0.0  0.0      0     0 ?        I    15:10   0:00 [kworker/u32:0-flush-0:57]
root      106015  0.0  0.0      0     0 ?        I    15:10   0:00 [kworker/0:2-mm_percpu_wq]
vy43meti  106047  0.0  0.0  18596  4420 pts/1    Ss+  15:10   0:00 /usr/bin/bash --init-file /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61ed4/out/vs/workbench/contrib/termina
root      106100  0.0  0.0      0     0 ?        I    15:10   0:00 [kworker/6:1]
root      107214  0.0  0.0      0     0 ?        I    15:13   0:00 [kworker/3:1-mm_percpu_wq]
root      107725  0.0  0.0      0     0 ?        I    15:14   0:00 [kworker/1:1-events]
root      108429  0.0  0.0      0     0 ?        I    15:16   0:00 [kworker/12:2-mm_percpu_wq]
vy43meti  108674 28.3  4.5 21205404 2989772 ?    Sl   15:16   0:24 /clibs/miniforge3/envs/simbed/bin/python -m ipykernel_launcher --ip=127.0.0.1 --stdin=9003 --control=9001 --hb=9000 --Session.signatur

Log:

info 15:15:19.63: Starting raw kernel 'simbed (Python 3.9.13)' for interpreter /clibs/miniforge3/envs/simbed/bin/python
info 15:15:19.92: Process Execution: > /clibs/miniforge3/envs/simbed/bin/python -c "import ipykernel; print(ipykernel.__version__); print("5dc3a68c-e34e-4080-9c3e-2a532b2ccb4d"); print(ipykernel.__file__)"
> /clibs/miniforge3/envs/simbed/bin/python -c "import ipykernel; print(ipykernel.__version__); print("5dc3a68c-e34e-4080-9c3e-2a532b2ccb4d"); print(ipykernel.__file__)"
info 15:15:19.95: Kernel launching with ports 9000,9001,9002,9003,9004. Start port is 9000
info 15:15:19.137: Process Execution: > /clibs/miniforge3/envs/simbed/bin/python -m ipykernel_launcher --ip=127.0.0.1 --stdin=9003 --control=9001 --hb=9000 --Session.signature_scheme="hmac-sha256" --Session.key=b"8c98bbc0-1064-4299-9268-f86e1fc16a90" --shell=9002 --transport="tcp" --iopub=9004 --f=/home/rzlin/vy43meti/.local/share/jupyter/runtime/kernel-v2-103169E76xPksLE88j.json
> /clibs/miniforge3/envs/simbed/bin/python -m ipykernel_launcher --ip=127.0.0.1 --stdin=9003 --control=9001 --hb=9000 --Session.signature_scheme="hmac-sha256" --Session.key=b"8c98bbc0-1064-4299-9268-f86e1fc16a90" --shell=9002 --transport="tcp" --iopub=9004 --f=/home/rzlin/vy43meti/.local/share/jupyter/runtime/kernel-v2-103169E76xPksLE88j.json
info 15:15:19.137: Process Execution: cwd: /clibs/simon/simbed
cwd: /clibs/simon/simbed
info 15:15:19.278: ipykernel version 6.15.1 for /clibs/miniforge3/envs/simbed/bin/python
info 15:15:19.279: ipykernel location /clibs/miniforge3/envs/simbed/lib/python3.9/site-packages/ipykernel/__init__.py for /clibs/miniforge3/envs/simbed/bin/python
warn 15:15:19.546: StdErr from Kernel Process /clibs/miniforge3/envs/simbed/lib/python3.9/site-packages/traitlets/traitlets.py:2392: FutureWarning: Supporting extra quotes around strings is deprecated in traitlets 5.0. You can use 'hmac-sha256' instead of '"hmac-sha256"' if you require traitlets >=5.
  warn(
/clibs/miniforge3/envs/simbed/lib/python3.9/site-packages/traitlets/traitlets.py:2346: FutureWarning: Supporting extra quotes around Bytes is deprecated in traitlets 5.0. Use '8c98bbc0-1064-4299-9268-f86e1fc16a90' instead of 'b"8c98bbc0-1064-4299-9268-f86e1fc16a90"'.
  warn(

info 15:15:19.582: Kernel Output: NOTE: When using the `ipython kernel` entry point, Ctrl-C will not work.

To exit, you will have to explicitly quit this process, by either sending
"quit" from a client, or using Ctrl-\ in UNIX-like environments.

To read more about this, see https://github.com/ipython/ipython/issues/2049


To connect another client to this kernel, use:
    --existing kernel-v2-103169E76xPksLE88j.json

info 15:15:19.779: Started kernel simbed (Python 3.9.13)., (Raw session started and connected)
info 15:15:19.780: Finished connecting 944d57ce-a46a-4353-87cb-475e655282f3
info 15:15:19.794: UpdateWorkingDirectoryAndPath in Kernel
info 15:15:19.795: Executing silently Code (busy) = import os\nimport sys\n%cd "//clibs/simon/simbed"\nif os.getcwd() not in sys.path:\nsys.path.insert(
info 15:15:19.947: Executing silently Code (completed) = import os\nimport sys\n%cd "//clibs/simon/simbed"\nif os.getcwd() not in sys.path:\nsys.path.insert( with 1 output(s)
info 15:15:19.947: Waiting for idle on (kernel): f57ca31a-fbc9-49a0-8656-1b6e6535b4ae -> idle
info 15:15:19.947: Finished waiting for idle on (kernel): f57ca31a-fbc9-49a0-8656-1b6e6535b4ae -> idle
info 15:15:19.984: Widget Message: Received IPyWidgets_kernelOptions in ScriptManager
info 15:15:19.992: Widget Message: Received IPyWidgetMessages.IPyWidgets_kernelOptions
info 15:15:19.997: Widget Message: Received IPyWidgets_kernelOptions in ScriptManager
info 15:15:19.997: Widget Message: Received IPyWidgetMessages.IPyWidgets_kernelOptions
info 15:15:19.997: Widget Message: data-base-url set to https://vscode-remote%2Bssh-002dremote-002bws.vscode-resource.vscode-cdn.net/clibs/.vscode-server-insiders/extensions/ms-toolsai.jupyter-2022.8.1002391036/tmp/scripts/40ee95752db98f0eef8e706d3247480fc89bff4986d79a04b757c6cb7513cfaa/jupyter
info 15:15:19.997: Widget Message: data-base-url set to https://vscode-remote%2Bssh-002dremote-002bws.vscode-resource.vscode-cdn.net/clibs/.vscode-server-insiders/extensions/ms-toolsai.jupyter-2022.8.1002391036/tmp/scripts/40ee95752db98f0eef8e706d3247480fc89bff4986d79a04b757c6cb7513cfaa/jupyter
info 15:15:20.966: Cell 0 executed with state Success
info 15:15:43.538: Disposing kernel .jvsc74a57bd0043dff6dfa37d76807ffa6ff43fcf097b462eccfbdb014405e7c9af6eb504a80./clibs/miniforge3/envs/simbed/python./clibs/miniforge3/envs/simbed/python.-m#ipykernel_launcher for notebook /clibs/simon/simbed/matlab_engine.ipynb due to selection of another kernel or closing of the notebook
info 15:15:43.538: Dispose Kernel '/clibs/simon/simbed/matlab_engine.ipynb' associated with '/clibs/simon/simbed/matlab_engine.ipynb'
info 15:15:43.597: Cancel pending cells
info 15:16:18.650: Preferred Remote kernel for /clibs/simon/simbed/actor_critic_myself.ipynb is undefined
info 15:16:18.656: Preferred Remote kernel for /clibs/simon/simbed/actor_critic_myself.ipynb is undefined
info 15:16:18.656: Find preferred kernel for /clibs/simon/simbed/actor_critic_myself.ipynb with metadata {"kernelspec":{"display_name":"Python 3.9.13 ('simbed')","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.9.13"},"orig_nbformat":4,"vscode":{"interpreter":{"hash":"043dff6dfa37d76807ffa6ff43fcf097b462eccfbdb014405e7c9af6eb504a80"}}} & preferred interpreter /clibs/miniforge3/envs/simbed/bin/python
info 15:16:18.658: Preferred Remote kernel for /clibs/simon/simbed/actor_critic_myself.ipynb is undefined
info 15:16:18.658: Preferred kernel .jvsc74a57bd0043dff6dfa37d76807ffa6ff43fcf097b462eccfbdb014405e7c9af6eb504a80./clibs/miniforge3/envs/simbed/python./clibs/miniforge3/envs/simbed/python.-m#ipykernel_launcher is exact match or top match for non python kernels, (false, [object Object], true, false)
info 15:16:18.659: PreferredConnection: .jvsc74a57bd0043dff6dfa37d76807ffa6ff43fcf097b462eccfbdb014405e7c9af6eb504a80./clibs/miniforge3/envs/simbed/python./clibs/miniforge3/envs/simbed/python.-m#ipykernel_launcher found for NotebookDocument: /clibs/simon/simbed/actor_critic_myself.ipynb
info 15:16:19.580: Process Execution: > /clibs/miniforge3/envs/simbed/bin/python -m pip list
> /clibs/miniforge3/envs/simbed/bin/python -m pip list
info 15:16:44.151: Execute Cell 0 /clibs/simon/simbed/actor_critic_myself.ipynb
info 15:16:44.154: Starting Jupyter Session id = 'startUsingPythonInterpreter:.jvsc74a57bd0043dff6dfa37d76807ffa6ff43fcf097b462eccfbdb014405e7c9af6eb504a80./clibs/miniforge3/envs/simbed/python./clibs/miniforge3/envs/simbed/python.-m#ipykernel_launcher' (Python Path: /clibs/miniforge3/envs/simbed, EnvType: Conda, EnvName: 'simbed', Version: 3.9.13) for '/clibs/simon/simbed/actor_critic_myself.ipynb' (disableUI=false)
info 15:16:44.156: Creating raw notebook for resource '/clibs/simon/simbed/actor_critic_myself.ipynb'
info 15:16:44.156: Computing working directory for resource '/clibs/simon/simbed/actor_critic_myself.ipynb'
info 15:16:44.165: Starting raw kernel 'simbed (Python 3.9.13)' for interpreter /clibs/miniforge3/envs/simbed/bin/python
info 15:16:44.195: Process Execution: > /clibs/miniforge3/envs/simbed/bin/python -c "import ipykernel; print(ipykernel.__version__); print("5dc3a68c-e34e-4080-9c3e-2a532b2ccb4d"); print(ipykernel.__file__)"
> /clibs/miniforge3/envs/simbed/bin/python -c "import ipykernel; print(ipykernel.__version__); print("5dc3a68c-e34e-4080-9c3e-2a532b2ccb4d"); print(ipykernel.__file__)"
info 15:16:44.197: Kernel launching with ports 9000,9001,9002,9003,9004. Start port is 9000
info 15:16:44.217: Process Execution: > /clibs/miniforge3/envs/simbed/bin/python -m ipykernel_launcher --ip=127.0.0.1 --stdin=9003 --control=9001 --hb=9000 --Session.signature_scheme="hmac-sha256" --Session.key=b"cdcc0268-6708-4f2e-b851-94a6eafa0042" --shell=9002 --transport="tcp" --iopub=9004 --f=/home/rzlin/vy43meti/.local/share/jupyter/runtime/kernel-v2-1031692dp6eG1MC5Fz.json
> /clibs/miniforge3/envs/simbed/bin/python -m ipykernel_launcher --ip=127.0.0.1 --stdin=9003 --control=9001 --hb=9000 --Session.signature_scheme="hmac-sha256" --Session.key=b"cdcc0268-6708-4f2e-b851-94a6eafa0042" --shell=9002 --transport="tcp" --iopub=9004 --f=/home/rzlin/vy43meti/.local/share/jupyter/runtime/kernel-v2-1031692dp6eG1MC5Fz.json
info 15:16:44.217: Process Execution: cwd: /clibs/simon/simbed
cwd: /clibs/simon/simbed
info 15:16:44.320: ipykernel version 6.15.1 for /clibs/miniforge3/envs/simbed/bin/python
info 15:16:44.320: ipykernel location /clibs/miniforge3/envs/simbed/lib/python3.9/site-packages/ipykernel/__init__.py for /clibs/miniforge3/envs/simbed/bin/python
warn 15:16:44.593: StdErr from Kernel Process /clibs/miniforge3/envs/simbed/lib/python3.9/site-packages/traitlets/traitlets.py:2392: FutureWarning: Supporting extra quotes around strings is deprecated in traitlets 5.0. You can use 'hmac-sha256' instead of '"hmac-sha256"' if you require traitlets >=5.
  warn(
/clibs/miniforge3/envs/simbed/lib/python3.9/site-packages/traitlets/traitlets.py:2346: FutureWarning: Supporting extra quotes around Bytes is deprecated in traitlets 5.0. Use 'cdcc0268-6708-4f2e-b851-94a6eafa0042' instead of 'b"cdcc0268-6708-4f2e-b851-94a6eafa0042"'.
  warn(

info 15:16:44.630: Kernel Output: NOTE: When using the `ipython kernel` entry point, Ctrl-C will not work.

To exit, you will have to explicitly quit this process, by either sending
"quit" from a client, or using Ctrl-\ in UNIX-like environments.

To read more about this, see https://github.com/ipython/ipython/issues/2049


To connect another client to this kernel, use:
    --existing kernel-v2-1031692dp6eG1MC5Fz.json

info 15:16:44.724: Started kernel simbed (Python 3.9.13)., (Raw session started and connected)
info 15:16:44.724: Finished connecting 944d57ce-a46a-4353-87cb-475e655282f3
info 15:16:44.729: UpdateWorkingDirectoryAndPath in Kernel
info 15:16:44.730: Executing silently Code (busy) = import os\nimport sys\n%cd "//clibs/simon/simbed"\nif os.getcwd() not in sys.path:\nsys.path.insert(
info 15:16:44.851: Executing silently Code (completed) = import os\nimport sys\n%cd "//clibs/simon/simbed"\nif os.getcwd() not in sys.path:\nsys.path.insert( with 1 output(s)
info 15:16:44.851: Waiting for idle on (kernel): b10de406-81a9-47b8-bb43-fe82163dcc09 -> idle
info 15:16:44.851: Finished waiting for idle on (kernel): b10de406-81a9-47b8-bb43-fe82163dcc09 -> idle
info 15:16:44.885: Widget Message: Received IPyWidgets_kernelOptions in ScriptManager
info 15:16:44.890: Widget Message: Received IPyWidgetMessages.IPyWidgets_kernelOptions
info 15:16:44.902: Widget Message: data-base-url set to https://vscode-remote%2Bssh-002dremote-002bws.vscode-resource.vscode-cdn.net/clibs/.vscode-server-insiders/extensions/ms-toolsai.jupyter-2022.8.1002391036/tmp/scripts/40ee95752db98f0eef8e706d3247480fc89bff4986d79a04b757c6cb7513cfaa/jupyter
info 15:16:45.428: Cell 0 executed with state Success
info 15:16:47.635: Execute Cell 1 /clibs/simon/simbed/actor_critic_myself.ipynb
info 15:16:47.758: Cell 1 executed with state Success
info 15:16:47.897: Execute Cell 2 /clibs/simon/simbed/actor_critic_myself.ipynb
info 15:16:48.15: Cell 2 executed with state Success
info 15:16:48.334: Execute Cell 3 /clibs/simon/simbed/actor_critic_myself.ipynb
info 15:16:48.479: Cell 3 executed with state Success
info 15:16:48.658: Execute Cell 4 /clibs/simon/simbed/actor_critic_myself.ipynb
info 15:16:48.926: Execute Cell 5 /clibs/simon/simbed/actor_critic_myself.ipynb
info 15:16:49.309: Execute Cell 6 /clibs/simon/simbed/actor_critic_myself.ipynb
warn 15:16:50.202: StdErr from Kernel Process pybullet build time: May 20 2022 19:45:31

info 15:16:50.208: Cell 4 executed with state Success
info 15:16:50.245: Execute Cell 7 /clibs/simon/simbed/actor_critic_myself.ipynb
info 15:16:50.286: Cell 5 executed with state Success
info 15:16:50.619: Execute Cell 8 /clibs/simon/simbed/actor_critic_myself.ipynb
info 15:16:51.29: Execute Cell 9 /clibs/simon/simbed/actor_critic_myself.ipynb
info 15:16:51.111: Cell 6 executed with state Success
info 15:16:51.155: Cell 7 executed with state Success
info 15:16:51.200: Cell 8 executed with state Success
info 15:16:51.443: Execute Cell 10 /clibs/simon/simbed/actor_critic_myself.ipynb
info 15:16:51.698: Cell 9 executed with state Success
info 15:16:51.769: Cell 10 executed with state Success
info 15:16:51.983: Execute Cell 11 /clibs/simon/simbed/actor_critic_myself.ipynb
info 15:16:53.408: Execute Cell 12 /clibs/simon/simbed/actor_critic_myself.ipynb
info 15:16:56.703: Cell 11 executed with state Success
info 15:16:56.768: Kernel Output: NOTE: When using the `ipython kernel` entry point, Ctrl-C will not work.

To exit, you will have to explicitly quit this process, by either sending
"quit" from a client, or using Ctrl-\ in UNIX-like environments.

To read more about this, see https://github.com/ipython/ipython/issues/2049


To connect another client to this kernel, use:
    --existing kernel-v2-1031692dp6eG1MC5Fz.json
argv[0]=
argv[0]=

info 15:17:4.453: Execute Cell 13 /clibs/simon/simbed/actor_critic_myself.ipynb
info 15:17:5.358: Cell 12 executed with state Success
info 15:17:7.289: Cell 13 executed with state Success
info 15:17:48.775: Disposing kernel .jvsc74a57bd0043dff6dfa37d76807ffa6ff43fcf097b462eccfbdb014405e7c9af6eb504a80./clibs/miniforge3/envs/simbed/python./clibs/miniforge3/envs/simbed/python.-m#ipykernel_launcher for notebook /clibs/simon/simbed/actor_critic_myself.ipynb due to selection of another kernel or closing of the notebook
info 15:17:48.775: Dispose Kernel '/clibs/simon/simbed/actor_critic_myself.ipynb' associated with '/clibs/simon/simbed/actor_critic_myself.ipynb'
info 15:17:48.833: Cancel pending cells

Now, this one process does not get disposed/killed/canceled after i close the notebook or VSCode. But look at the statement in the jupyter-log.

**To exit, you will have to explicitly quit this process, by either sending "quit" from a client, or using Ctrl-\ in UNIX-like environments.

To read more about this, see https://github.com/ipython/ipython/issues/2049**

This seems to be the problem.

simon-bachhuber avatar Aug 25 '22 11:08 simon-bachhuber

Now, this one process does not get disposed/killed/canceled after i close the notebook or VSCode.

Can you run ps aux ? grep bin/python after you run a cell and after you close all of the files. I believe the remaining python process is the one i mentioned that would still hang around. Ideally you should have 2 python processes after running a cell, and then just 1 after closing all of the files.

DonJayamanne avatar Aug 25 '22 16:08 DonJayamanne

After connecting with VSCode to Remote but before running a cell ps aux

vy43meti    3920  0.0  0.0   2624   536 ?        S    13:52   0:00 sh /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d9
vy43meti    3930  2.1  0.1 959408 95316 ?        Sl   13:52   0:03 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1
vy43meti    3979  0.2  0.0 672900 45692 ?        Sl   13:52   0:00 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1
vy43meti    4005  5.9  0.3 1111072 261240 ?      Sl   13:52   0:08 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1
vy43meti    4048  0.0  0.0  18596  4244 pts/3    Ss+  13:52   0:00 /usr/bin/bash --init-file /clibs/.vscode-server-insiders/bin/7ed02a69
root        4127  0.0  0.0  52156 14136 ?        Ss   13:52   0:00 sshd: vy43meti [priv]
vy43meti    4319  0.0  0.0  52412  7116 ?        S    13:52   0:00 sshd: vy43meti@pts/4
vy43meti    4320  0.0  0.0  19568  5368 pts/4    Ss   13:52   0:00 -bash
root        4461  0.0  0.0      0     0 ?        I    13:52   0:00 [kworker/u32:5-nfsiod]
root        4462  0.0  0.0      0     0 ?        I    13:52   0:00 [kworker/u32:6-rpciod]
root        4463  0.0  0.0      0     0 ?        I    13:52   0:00 [kworker/u32:7-events_unbound]
root        4464  0.0  0.0      0     0 ?        I    13:52   0:00 [kworker/u32:8-rpciod]
root        4465  0.0  0.0      0     0 ?        I    13:52   0:00 [kworker/u32:9]
root        4466  0.0  0.0      0     0 ?        I    13:52   0:00 [kworker/u32:10-events_unbound]
root        4513  0.0  0.0      0     0 ?        I    13:53   0:00 [kworker/1:1-events]
root        4678  0.0  0.0      0     0 ?        I    13:53   0:00 [kworker/2:2-mm_percpu_wq]
vy43meti    5022  1.0  0.0 603868 54340 ?        Sl   13:54   0:00 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1
root        5097  0.0  0.0      0     0 ?        I    13:54   0:00 [kworker/15:0-events]
vy43meti    5269  0.0  0.0  20192  3408 pts/4    R+   13:54   0:00 ps aux

After running a specific cell

vy43meti    3920  0.0  0.0   2624   536 ?        S    13:52   0:00 sh /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a
vy43meti    3930  0.7  0.1 963492 101292 ?       Sl   13:52   0:07 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61e
vy43meti    3979  0.1  0.0 715564 49312 ?        Sl   13:52   0:01 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61e
root        4127  0.0  0.0  52156 14136 ?        Ss   13:52   0:00 sshd: vy43meti [priv]
vy43meti    4319  0.0  0.0  52412  7116 ?        S    13:52   0:00 sshd: vy43meti@pts/4
vy43meti    4320  0.0  0.0  19568  5368 pts/4    Ss   13:52   0:00 -bash
root        4461  0.0  0.0      0     0 ?        I    13:52   0:00 [kworker/u32:5-rpciod]
root        4463  0.0  0.0      0     0 ?        I    13:52   0:00 [kworker/u32:7-rpciod]
root        4466  0.0  0.0      0     0 ?        I    13:52   0:00 [kworker/u32:10-events_power_efficient]
root        4678  0.0  0.0      0     0 ?        I    13:53   0:00 [kworker/2:2-events]
root        5097  0.0  0.0      0     0 ?        I    13:54   0:00 [kworker/15:0-mm_percpu_wq]
root        5690  0.0  0.0  52284 13996 ?        Ss   13:56   0:00 sshd: vy43meti [priv]
vy43meti    5871  0.0  0.0  52468  7768 ?        S    13:56   0:00 sshd: vy43meti@notty
vy43meti    5872  0.0  0.0  18332  3776 ?        Ss   13:56   0:00 -bash
vy43meti    5884  0.0  0.0  10388  4096 ?        S    13:56   0:00 bash
vy43meti    5935  4.7  0.3 1176656 216664 ?      Sl   13:56   0:32 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61e
vy43meti    5946  0.1  0.1 1032112 96616 ?       Sl   13:56   0:00 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61e
vy43meti    5991  0.0  0.0  18596  4320 pts/3    Ss+  13:56   0:00 /usr/bin/bash --init-file /clibs/.vscode-server-insiders/bin/7ed02a69658f
vy43meti    6127  0.0  0.0 590228 39988 ?        Sl   13:56   0:00 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61e
root        6857  0.0  0.0      0     0 ?        I    13:57   0:00 [kworker/6:0-mm_percpu_wq]
root        7075  0.0  0.0      0     0 ?        I    13:58   0:00 [kworker/1:0-events]
vy43meti    8127 29.9  1.9 2231588 1309248 ?     Sl   14:00   2:06 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61e
vy43meti    8449  106  3.2 20521080 2138876 ?    Sl   14:01   6:42 /clibs/miniforge3/envs/simbed/bin/python -m ipykernel_launcher --ip=127.0
root        8503  0.0  0.0      0     0 ?        S    14:01   0:00 [UVM GPU1 BH]
root        8504  0.0  0.0      0     0 ?        S    14:01   0:00 [UVM GPU1 KC]
root        8813  0.0  0.0      0     0 ?        I    14:01   0:00 [kworker/u32:0-events_unbound]
root        9082  0.0  0.0      0     0 ?        I    14:02   0:00 [kworker/9:2-mm_percpu_wq]
root        9308  0.0  0.0      0     0 ?        I    14:02   0:00 [kworker/14:2]
root        9513  0.0  0.0      0     0 ?        I    14:03   0:00 [kworker/1:1-events]
vy43meti    9991  0.1  0.0 118932 40968 ?        S    14:04   0:00 pdflatex -halt-on-error
root       11825  0.0  0.0      0     0 ?        I    14:07   0:00 [kworker/u32:1-rpciod]
vy43meti   11871  0.0  0.0  20192  3440 pts/4    R+   14:07   0:00 ps aux

After closing the notebook in VSCode

vy43meti    3920  0.0  0.0   2624   536 ?        S    13:52   0:00 sh /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a
vy43meti    3930  0.7  0.1 963492 101812 ?       Sl   13:52   0:07 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61e
vy43meti    3979  0.1  0.0 715564 49524 ?        Sl   13:52   0:01 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61e
root        4127  0.0  0.0  52156 14136 ?        Ss   13:52   0:00 sshd: vy43meti [priv]
vy43meti    4319  0.0  0.0  52412  7116 ?        S    13:52   0:00 sshd: vy43meti@pts/4
vy43meti    4320  0.0  0.0  19568  5368 pts/4    Ss   13:52   0:00 -bash
root        4461  0.0  0.0      0     0 ?        I    13:52   0:00 [kworker/u32:5-rpciod]
root        4463  0.0  0.0      0     0 ?        I    13:52   0:00 [kworker/u32:7-rpciod]
root        4466  0.0  0.0      0     0 ?        I    13:52   0:00 [kworker/u32:10-events_unbound]
root        4678  0.0  0.0      0     0 ?        I    13:53   0:00 [kworker/2:2-events]
root        5097  0.0  0.0      0     0 ?        I    13:54   0:00 [kworker/15:0-mm_percpu_wq]
root        5690  0.0  0.0  52284 13996 ?        Ss   13:56   0:00 sshd: vy43meti [priv]
vy43meti    5871  0.0  0.0  52468  7768 ?        S    13:56   0:00 sshd: vy43meti@notty
vy43meti    5872  0.0  0.0  18332  3776 ?        Ss   13:56   0:00 -bash
vy43meti    5884  0.0  0.0  10388  4096 ?        S    13:56   0:00 bash
vy43meti    5935  4.5  0.3 1179984 207800 ?      Sl   13:56   0:35 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61e
vy43meti    5946  0.1  0.1 1032112 96616 ?       Sl   13:56   0:00 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61e
vy43meti    5991  0.0  0.0  18596  4320 pts/3    Ss+  13:56   0:00 /usr/bin/bash --init-file /clibs/.vscode-server-insiders/bin/7ed02a69658f
vy43meti    6127  0.0  0.0 590228 39988 ?        Sl   13:56   0:00 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61e
root        6857  0.0  0.0      0     0 ?        I    13:57   0:00 [kworker/6:0-mm_percpu_wq]
vy43meti    8127 25.1  1.5 1805656 1034568 ?     Sl   14:00   2:06 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61e
vy43meti    8449 88.0  3.2 20439112 2138936 ?    Sl   14:01   6:43 /clibs/miniforge3/envs/simbed/bin/python -m ipykernel_launcher --ip=127.0
root        8503  0.0  0.0      0     0 ?        S    14:01   0:00 [UVM GPU1 BH]
root        8504  0.0  0.0      0     0 ?        S    14:01   0:00 [UVM GPU1 KC]
root        8813  0.0  0.0      0     0 ?        I    14:01   0:00 [kworker/u32:0-events_unbound]
root        9082  0.0  0.0      0     0 ?        I    14:02   0:00 [kworker/9:2-mm_percpu_wq]
root        9308  0.0  0.0      0     0 ?        I    14:02   0:00 [kworker/14:2]
root        9513  0.0  0.0      0     0 ?        I    14:03   0:00 [kworker/1:1-events]
root       11825  0.0  0.0      0     0 ?        I    14:07   0:00 [kworker/u32:1-rpciod]
root       12297  0.0  0.0      0     0 ?        I    14:08   0:00 [kworker/1:0-events]
vy43meti   12401  0.0  0.0  20192  3564 pts/4    R+   14:08   0:00 ps aux

After closing the connection to remote and closing VSCode (connected via Terminal to Remote)

vy43meti    3920  0.0  0.0   2624   536 ?        S    13:52   0:00 sh /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a
vy43meti    3930  0.7  0.1 963492 101716 ?       Sl   13:52   0:07 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61e
vy43meti    3979  0.1  0.0 715564 48904 ?        Sl   13:52   0:01 /clibs/.vscode-server-insiders/bin/7ed02a69658fc07f08740b98fa0d8d96c1a61e
root        4127  0.0  0.0  52156 14136 ?        Ss   13:52   0:00 sshd: vy43meti [priv]
vy43meti    4319  0.0  0.0  52412  7116 ?        S    13:52   0:00 sshd: vy43meti@pts/4
vy43meti    4320  0.0  0.0  19568  5368 pts/4    Ss   13:52   0:00 -bash
root        4461  0.0  0.0      0     0 ?        I    13:52   0:00 [kworker/u32:5-rpciod]
root        4463  0.0  0.0      0     0 ?        I    13:52   0:00 [kworker/u32:7-rpciod]
root        4466  0.0  0.0      0     0 ?        I    13:52   0:00 [kworker/u32:10-events_unbound]
root        4678  0.0  0.0      0     0 ?        I    13:53   0:00 [kworker/2:2-mm_percpu_wq]
root        5097  0.0  0.0      0     0 ?        I    13:54   0:00 [kworker/15:0-events]
root        6857  0.0  0.0      0     0 ?        I    13:57   0:00 [kworker/6:0-events]
vy43meti    8449 72.5  3.2 20439112 2138936 ?    Sl   14:01   6:43 /clibs/miniforge3/envs/simbed/bin/python -m ipykernel_launcher --ip=127.0
root        8503  0.0  0.0      0     0 ?        S    14:01   0:00 [UVM GPU1 BH]
root        8504  0.0  0.0      0     0 ?        S    14:01   0:00 [UVM GPU1 KC]
root        8813  0.0  0.0      0     0 ?        I    14:01   0:00 [kworker/u32:0-events_unbound]
root        9082  0.0  0.0      0     0 ?        I    14:02   0:00 [kworker/9:2-mm_percpu_wq]
root        9308  0.0  0.0      0     0 ?        I    14:02   0:00 [kworker/14:2]
root        9513  0.0  0.0      0     0 ?        I    14:03   0:00 [kworker/1:1-events]
root       11825  0.0  0.0      0     0 ?        I    14:07   0:00 [kworker/u32:1-rpciod]
root       12297  0.0  0.0      0     0 ?        I    14:08   0:00 [kworker/1:0-events]
root       12922  0.0  0.0      0     0 ?        I    14:10   0:00 [kworker/6:2-mm_percpu_wq]
vy43meti   12927  0.0  0.0  20192  3440 pts/4    R+   14:10   0:00 ps aux

The notebook-process is still running and also allocating GPU memory. Nvidia-smi after closing VSCode Screenshot from 2022-08-27 12-13-48

Jupyter-log file juypter_output_log.txt

simon-bachhuber avatar Aug 27 '22 10:08 simon-bachhuber

thanks for your help and patience again. can you turn the logging kernel on to. verbose. go into user settings and search for jupyter logging and changes the value to verbose.

then try the same steps and send the logs again

DonJayamanne avatar Aug 27 '22 11:08 DonJayamanne

The steps were

  1. Open Notebook
  2. Run a couple of cells
  3. Close notebook

I also checked that the notebook-process does indeed still live on (and also allocate GPU) after closing notebook.

jupyter_logging_verbose.txt

simon-bachhuber avatar Aug 30 '22 07:08 simon-bachhuber

@SimiPixel Thanks, please could you run just one cell with the code print("Hello World") I want to ensure we don't have any other side effects from other cells, e.g. stuff that uses GPU or the like that could complicate things. Let me know if that works, if not, I'll send a custom VSIX with additional logging to see whats going on at your end.

DonJayamanne avatar Aug 31 '22 18:08 DonJayamanne

Well this is not really possible because as mentioned above

It is dependent on the code i run in the cell. Using only a print-statement i can not reproduce the bug. However, with specific code i can create the following:

By the bug i mean the fact that the process persists even after VSCode is closed.

simon-bachhuber avatar Sep 02 '22 14:09 simon-bachhuber

@SimiPixel I will provide a custom VSIX to capture additional logs.

DonJayamanne avatar Sep 20 '22 05:09 DonJayamanne

@SimiPixel I've added additional logging for this, please could you

  • Install the latest pre-release version of the Jupyter extension
  • Install the latest insider version of VS Code
  • Follow the steps you have provided here https://github.com/microsoft/vscode-jupyter/issues/11177#issuecomment-1231279717

I'm sorry i haven't had much luck with this, hence the request for additonal logs (as mentioend I've added more logging that would help me identify the cauase of this issue)

DonJayamanne avatar Oct 03 '22 00:10 DonJayamanne

Closing this issue as its been over 4 weeks, since the information was requested. We'll be happy to reopen the issue when the requested information has been provided.

DonJayamanne avatar Dec 04 '22 19:12 DonJayamanne