enterprise_gateway
enterprise_gateway copied to clipboard
Published
20 hours ago •
jupyter-server
jupyter-server
Local Enterprise Gateway fails to start kernel with "Fatal Python error: failed to get random numbers to initialize Python"
I hate to spam you, Kevin.
I'm doing a local basic Enterprise Gateway local install (hopefully for more websocket testing in the future!)
Here's my setup (following the general guide). I did the clean install to make sure the error wasn't specific to my original environment.
conda create --name gateway python=3.6
conda activate gateway
conda install -c conda-forge jupyter_enterprise_gateway
I then start Enterprise Gateway with
jupyter enterprisegateway --ip=0.0.0.0 --port_retries=0 --log-level=DEBUG
which launches the Gateway on port 8888.
and my notebook with
jupyter notebook --gateway-url=http://localhost:8888 --port=7000 --GatewayClient.http_user=guest --GatewayClient.http_pwd=guest-password
in a different terminal.
Both processes initially function fine. /api/kernelspecs returns correctly, the kernel starts, then refreshes. The "Fatal Python error: failed to get random numbers to initialize Python" fails then.
Here's the detailed logs:
[D 2020-12-01 21:07:42.225 EnterpriseGatewayApp] Searching ['C:\\Users\\Operator', 'C:\\Users\\Operator\\.jupyter', 'C:\\Users\\Operator\\anaconda3\\envs\\gateway\\etc\\jupyter', 'C:\\ProgramData\\jupyter'] for config files
[D 2020-12-01 21:07:42.226 EnterpriseGatewayApp] Looking for jupyter_config in C:\ProgramData\jupyter
[D 2020-12-01 21:07:42.227 EnterpriseGatewayApp] Looking for jupyter_config in C:\Users\Operator\anaconda3\envs\gateway\etc\jupyter
[D 2020-12-01 21:07:42.231 EnterpriseGatewayApp] Looking for jupyter_config in C:\Users\Operator\.jupyter
[D 2020-12-01 21:07:42.232 EnterpriseGatewayApp] Looking for jupyter_config in C:\Users\Operator
[D 2020-12-01 21:07:42.233 EnterpriseGatewayApp] Looking for jupyter_enterprise_gateway_config in C:\ProgramData\jupyter
[D 2020-12-01 21:07:42.234 EnterpriseGatewayApp] Looking for jupyter_enterprise_gateway_config in C:\Users\Operator\anaconda3\envs\gateway\etc\jupyter
[D 2020-12-01 21:07:42.235 EnterpriseGatewayApp] Looking for jupyter_enterprise_gateway_config in C:\Users\Operator\.jupyter
[D 2020-12-01 21:07:42.235 EnterpriseGatewayApp] Looking for jupyter_enterprise_gateway_config in C:\Users\Operator
[D 201201 21:07:42 selector_events:54] Using selector: SelectSelector
[I 2020-12-01 21:07:42.245 EnterpriseGatewayApp] Jupyter Enterprise Gateway 2.4.0 is available at http://0.0.0.0:8888
[D 2020-12-01 21:07:49.491 EnterpriseGatewayApp] Found kernel python3 in C:\Users\Operator\anaconda3\envs\gateway\share\jupyter\kernels
[D 2020-12-01 21:07:49.492 EnterpriseGatewayApp] Found kernel metakernel_python in C:\ProgramData\jupyter\kernels
[I 201201 21:07:49 web:2243] 200 GET /api/kernelspecs (127.0.0.1) 182.04ms
[D 2020-12-01 21:07:55.677 EnterpriseGatewayApp] Found kernel python3 in C:\Users\Operator\anaconda3\envs\gateway\share\jupyter\kernels
[D 2020-12-01 21:07:55.678 EnterpriseGatewayApp] Found kernel metakernel_python in C:\ProgramData\jupyter\kernels
[I 201201 21:07:55 web:2243] 200 GET /api/kernelspecs (127.0.0.1) 5.00ms
[D 2020-12-01 21:07:55.754 EnterpriseGatewayApp] RemoteMappingKernelManager.start_kernel: None, kernel_username: guest
[D 2020-12-01 21:07:55.769 EnterpriseGatewayApp] Instantiating kernel 'Python 3' with process proxy: enterprise_gateway.services.processproxies.processproxy.LocalProcessProxy
[D 2020-12-01 21:07:55.776 EnterpriseGatewayApp] Starting kernel (async): ['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-0f59d11b-cf82-4592-aa56-c351c5b19637.json']
[D 2020-12-01 21:07:55.777 EnterpriseGatewayApp] Launching kernel: 'Python 3' with command: ['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-0f59d11b-cf82-4592-aa56-c351c5b19637.json']
[D 2020-12-01 21:07:55.778 EnterpriseGatewayApp] BaseProcessProxy.launch_process() env: {'PATH': 'C:\\Users\\Operator\\anaconda3\\envs\\gateway;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\mingw-w64\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\usr\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Scripts;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\bin;C:\\Users\\Operator\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\libnvvp;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\libnvvp;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\PharosSystems\\Core;C:\\ProgramData\\chocolatey\\bin;C:\\Program Files (x86)\\Wolfram Research\\WolframScript;C:\\Program Files\\nodejs;C:\\Program Files\\Git\\cmd;C:\\Program Files\\PuTTY;C:\\Program Files\\Amazon\\AWSCLIV2;C:\\bin;C:\\Program Files (x86)\\GnuPG\\bin;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\ProgramData\\DockerDesktop\\version-bin;C:\\Program Files\\NVIDIA Corporation\\NVIDIA NvDLISR;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\lib\\x64;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUPTI\\lib64;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32\\Scripts;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Operator\\AppData\\Roaming\\npm;C:\\Users\\Operator\\AppData\\Local\\atom\\bin;C:\\Users\\Operator\\AppData\\Local\\GitHubDesktop\\bin;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;.', 'KERNEL_LAUNCH_TIMEOUT': '40', 'KERNEL_USERNAME': 'guest', 'KERNEL_WORKING_DIR': 'C:\\Users\\Operator', 'KERNEL_GATEWAY': '1', 'KERNEL_ID': '0f59d11b-cf82-4592-aa56-c351c5b19637', 'KERNEL_LANGUAGE': 'python', 'EG_IMPERSONATION_ENABLED': 'False'}
[I 2020-12-01 21:07:55.783 EnterpriseGatewayApp] Local kernel launched on '10.0.0.193', pid: 26996, pgid: 0, KernelID: 0f59d11b-cf82-4592-aa56-c351c5b19637, cmd: '['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-0f59d11b-cf82-4592-aa56-c351c5b19637.json']'
[D 2020-12-01 21:07:55.785 EnterpriseGatewayApp] Connecting to: tcp://127.0.0.1:59055
[D 2020-12-01 21:07:55.788 EnterpriseGatewayApp] Connecting to: tcp://127.0.0.1:59052
[I 2020-12-01 21:07:55.790 EnterpriseGatewayApp] Kernel started: 0f59d11b-cf82-4592-aa56-c351c5b19637, name: python3
[D 2020-12-01 21:07:55.790 EnterpriseGatewayApp] Kernel args: {'env': {'PATH': 'C:\\Users\\Operator\\anaconda3\\envs\\gateway;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\mingw-w64\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\usr\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Scripts;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\bin;C:\\Users\\Operator\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\libnvvp;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\libnvvp;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\PharosSystems\\Core;C:\\ProgramData\\chocolatey\\bin;C:\\Program Files (x86)\\Wolfram Research\\WolframScript;C:\\Program Files\\nodejs;C:\\Program Files\\Git\\cmd;C:\\Program Files\\PuTTY;C:\\Program Files\\Amazon\\AWSCLIV2;C:\\bin;C:\\Program Files (x86)\\GnuPG\\bin;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\ProgramData\\DockerDesktop\\version-bin;C:\\Program Files\\NVIDIA Corporation\\NVIDIA NvDLISR;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\lib\\x64;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUPTI\\lib64;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32\\Scripts;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Operator\\AppData\\Roaming\\npm;C:\\Users\\Operator\\AppData\\Local\\atom\\bin;C:\\Users\\Operator\\AppData\\Local\\GitHubDesktop\\bin;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;.', 'KERNEL_LAUNCH_TIMEOUT': '40', 'KERNEL_USERNAME': 'guest', 'KERNEL_WORKING_DIR': 'C:\\Users\\Operator'}, 'kernel_headers': {}, 'kernel_name': None}
Fatal Python error: failed to get random numbers to initialize Python
AsyncIOLoopKernelRestarter then takes over and repeats the start-stop-refresh-fail sequence five times.
A quick Google suggests this may have something to do with environment variables, if it's at all helpful. https://www.scivision.dev/python-calling-python-subprocess/
Hi Elliot, we have never officially qualified EG on Windows and I'm wondering if this is something related to that. I have personally never seen "Fatal Python error: failed to get random numbers to initialize Python" before. But let's keep plugging away here.
If the auto-restarts are happening, then that means the popen call is completing (to launch the kernel process), but the process itself is not getting off the ground. There should be a series of auto-restarts as you imply. Could you please provide at least one complete sequence of log messages for that?
We do pass env variables to the subprocess - which is evident in the last debug entry above. However, I believe this is not the case with the standard notebook server, in which case the env passed to the subprocess will be a copy of the notebook server's env. As a result, envs like SYSTEMROOT won't necessarily be present.
Could you please try the following? Start your EG server with this option:
--EnterpriseGatewayApp.env_process_whitelist="['SYSTEMROOT']"
This will transfer the value of the SYSTEMROOT env from the process to the kernel subprocess. It's a list-valued property, so there might be others, but I would recommend just adding one at a time. If you run into issues setting this on the command line, the following env could be set instead, which simply takes a comma-separated list of strings...
EG_ENV_PROCESS_WHITELIST=SYSTEMROOT
You're right. This is almost certainly a Windows-specific error. I did a simple deployment with the method in the docs on an EC2 instance and it worked beautifully.
The SYSTEMROOT variable was also a good call -- the original error is resolved. The newer error is
Bad file descriptor (D:\bld\zeromq_1605919615529\work\src\epoll.cpp:100)
and may have something to do with file cleanup by Python. I have no idea why Python would be trying to create and clean up files in my data drive, though.
Now that I've got a EC2 deployment running for cross-testing, I'll probably go and chew on the Kubernetes problem for a while. I'm happy to work with you more on getting EG operational on Windows, too, depending on whether you want to support Windows in the future.
Here are the (new) full logs, if you're interested.
(gateway) C:\Users\Operator>jupyter enterprisegateway --ip=0.0.0.0 --port=8888 --port_retries=0 --log-level=DEBUG --EnterpriseGatewayApp.env_process_whitelist="[ 'SYSTEMROOT' ]"
[D 2020-12-02 14:31:11.597 EnterpriseGatewayApp] Searching ['C:\\Users\\Operator', 'C:\\Users\\Operator\\.jupyter', 'C:\\Users\\Operator\\anaconda3\\envs\\gateway\\etc\\jupyter', 'C:\\ProgramData\\jupyter'] for config files
[D 2020-12-02 14:31:11.598 EnterpriseGatewayApp] Looking for jupyter_config in C:\ProgramData\jupyter
[D 2020-12-02 14:31:11.599 EnterpriseGatewayApp] Looking for jupyter_config in C:\Users\Operator\anaconda3\envs\gateway\etc\jupyter
[D 2020-12-02 14:31:11.599 EnterpriseGatewayApp] Looking for jupyter_config in C:\Users\Operator\.jupyter
[D 2020-12-02 14:31:11.599 EnterpriseGatewayApp] Looking for jupyter_config in C:\Users\Operator
[D 2020-12-02 14:31:11.600 EnterpriseGatewayApp] Looking for jupyter_enterprise_gateway_config in C:\ProgramData\jupyter
[D 2020-12-02 14:31:11.601 EnterpriseGatewayApp] Looking for jupyter_enterprise_gateway_config in C:\Users\Operator\anaconda3\envs\gateway\etc\jupyter
[D 2020-12-02 14:31:11.601 EnterpriseGatewayApp] Looking for jupyter_enterprise_gateway_config in C:\Users\Operator\.jupyter
[D 2020-12-02 14:31:11.602 EnterpriseGatewayApp] Looking for jupyter_enterprise_gateway_config in C:\Users\Operator
[D 201202 14:31:11 selector_events:54] Using selector: SelectSelector
[I 2020-12-02 14:31:11.612 EnterpriseGatewayApp] Jupyter Enterprise Gateway 2.4.0 is available at http://0.0.0.0:8888
[D 2020-12-02 14:31:25.875 EnterpriseGatewayApp] Found kernel python3 in C:\Users\Operator\anaconda3\envs\gateway\share\jupyter\kernels
[D 2020-12-02 14:31:25.875 EnterpriseGatewayApp] Found kernel metakernel_python in C:\ProgramData\jupyter\kernels
[I 201202 14:31:25 web:2243] 200 GET /api/kernelspecs (127.0.0.1) 192.00ms
[D 2020-12-02 14:31:30.218 EnterpriseGatewayApp] Found kernel python3 in C:\Users\Operator\anaconda3\envs\gateway\share\jupyter\kernels
[D 2020-12-02 14:31:30.218 EnterpriseGatewayApp] Found kernel metakernel_python in C:\ProgramData\jupyter\kernels
[I 201202 14:31:30 web:2243] 200 GET /api/kernelspecs (127.0.0.1) 6.00ms
[D 2020-12-02 14:31:30.547 EnterpriseGatewayApp] RemoteMappingKernelManager.start_kernel: python3, kernel_username: guest
[D 2020-12-02 14:31:30.563 EnterpriseGatewayApp] Instantiating kernel 'Python 3' with process proxy: enterprise_gateway.services.processproxies.processproxy.LocalProcessProxy
[D 2020-12-02 14:31:30.569 EnterpriseGatewayApp] Starting kernel (async): ['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-b26721de-573e-45cc-9c0c-c7ab3a14dcee.json']
[D 2020-12-02 14:31:30.570 EnterpriseGatewayApp] Launching kernel: 'Python 3' with command: ['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-b26721de-573e-45cc-9c0c-c7ab3a14dcee.json']
[D 2020-12-02 14:31:30.571 EnterpriseGatewayApp] BaseProcessProxy.launch_process() env: {'PATH': 'C:\\Users\\Operator\\anaconda3\\envs\\gateway;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\mingw-w64\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\usr\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Scripts;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\bin;C:\\Users\\Operator\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\libnvvp;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\libnvvp;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\PharosSystems\\Core;C:\\ProgramData\\chocolatey\\bin;C:\\Program Files (x86)\\Wolfram Research\\WolframScript;C:\\Program Files\\nodejs;C:\\Program Files\\Git\\cmd;C:\\Program Files\\PuTTY;C:\\Program Files\\Amazon\\AWSCLIV2;C:\\bin;C:\\Program Files (x86)\\GnuPG\\bin;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\ProgramData\\DockerDesktop\\version-bin;C:\\Program Files\\NVIDIA Corporation\\NVIDIA NvDLISR;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\lib\\x64;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUPTI\\lib64;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32\\Scripts;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Operator\\AppData\\Roaming\\npm;C:\\Users\\Operator\\AppData\\Local\\atom\\bin;C:\\Users\\Operator\\AppData\\Local\\GitHubDesktop\\bin;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;.', 'SYSTEMROOT': 'C:\\WINDOWS', 'KERNEL_LAUNCH_TIMEOUT': '40', 'KERNEL_USERNAME': 'guest', 'KERNEL_WORKING_DIR': 'C:\\Users\\Operator', 'KERNEL_GATEWAY': '1', 'KERNEL_ID': 'b26721de-573e-45cc-9c0c-c7ab3a14dcee', 'KERNEL_LANGUAGE': 'python', 'EG_IMPERSONATION_ENABLED': 'False'}
[I 2020-12-02 14:31:30.576 EnterpriseGatewayApp] Local kernel launched on '10.0.0.193', pid: 30812, pgid: 0, KernelID: b26721de-573e-45cc-9c0c-c7ab3a14dcee, cmd: '['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-b26721de-573e-45cc-9c0c-c7ab3a14dcee.json']'
[D 2020-12-02 14:31:30.578 EnterpriseGatewayApp] Connecting to: tcp://127.0.0.1:50755
[D 2020-12-02 14:31:30.582 EnterpriseGatewayApp] Connecting to: tcp://127.0.0.1:50752
[I 2020-12-02 14:31:30.584 EnterpriseGatewayApp] Kernel started: b26721de-573e-45cc-9c0c-c7ab3a14dcee, name: python3
[D 2020-12-02 14:31:30.584 EnterpriseGatewayApp] Kernel args: {'env': {'PATH': 'C:\\Users\\Operator\\anaconda3\\envs\\gateway;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\mingw-w64\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\usr\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Scripts;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\bin;C:\\Users\\Operator\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\libnvvp;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\libnvvp;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\PharosSystems\\Core;C:\\ProgramData\\chocolatey\\bin;C:\\Program Files (x86)\\Wolfram Research\\WolframScript;C:\\Program Files\\nodejs;C:\\Program Files\\Git\\cmd;C:\\Program Files\\PuTTY;C:\\Program Files\\Amazon\\AWSCLIV2;C:\\bin;C:\\Program Files (x86)\\GnuPG\\bin;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\ProgramData\\DockerDesktop\\version-bin;C:\\Program Files\\NVIDIA Corporation\\NVIDIA NvDLISR;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\lib\\x64;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUPTI\\lib64;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32\\Scripts;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Operator\\AppData\\Roaming\\npm;C:\\Users\\Operator\\AppData\\Local\\atom\\bin;C:\\Users\\Operator\\AppData\\Local\\GitHubDesktop\\bin;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;.', 'SYSTEMROOT': 'C:\\WINDOWS', 'KERNEL_LAUNCH_TIMEOUT': '40', 'KERNEL_USERNAME': 'guest', 'KERNEL_WORKING_DIR': 'C:\\Users\\Operator'}, 'kernel_headers': {}, 'kernel_name': 'python3'}
[I 201202 14:31:30 web:2243] 201 POST /api/kernels (127.0.0.1) 40.45ms
[D 2020-12-02 14:31:30.588 EnterpriseGatewayApp] Serving kernel resource from: C:\Users\Operator\anaconda3\envs\gateway\share\jupyter\kernels\python3
[I 201202 14:31:30 web:2243] 200 GET /kernelspecs/python3/logo-64x64.png (127.0.0.1) 4.04ms
[I 201202 14:31:30 web:2243] 200 GET /api/kernels/b26721de-573e-45cc-9c0c-c7ab3a14dcee (127.0.0.1) 1.00ms
Bad file descriptor (D:\bld\zeromq_1605919615529\work\src\epoll.cpp:100)
[I 201202 14:31:31 web:2243] 200 GET /api/kernels/b26721de-573e-45cc-9c0c-c7ab3a14dcee (127.0.0.1) 1.00ms
[D 2020-12-02 14:31:31.518 EnterpriseGatewayApp] Initializing websocket connection /api/kernels/b26721de-573e-45cc-9c0c-c7ab3a14dcee/channels
[W 2020-12-02 14:31:31.519 EnterpriseGatewayApp] No session ID specified
[D 2020-12-02 14:31:31.520 EnterpriseGatewayApp] Requesting kernel info from b26721de-573e-45cc-9c0c-c7ab3a14dcee
[D 2020-12-02 14:31:31.524 EnterpriseGatewayApp] Connecting to: tcp://127.0.0.1:50751
[I 2020-12-02 14:31:33.584 EnterpriseGatewayApp] AsyncIOLoopKernelRestarter: restarting kernel (1/5), new random ports
[D 2020-12-02 14:31:33.585 EnterpriseGatewayApp] BaseProcessProxy.terminate(): None
[D 2020-12-02 14:31:33.590 EnterpriseGatewayApp] Instantiating kernel 'Python 3' with process proxy: enterprise_gateway.services.processproxies.processproxy.LocalProcessProxy
[D 2020-12-02 14:31:33.594 EnterpriseGatewayApp] Starting kernel (async): ['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-b26721de-573e-45cc-9c0c-c7ab3a14dcee.json']
[D 2020-12-02 14:31:33.599 EnterpriseGatewayApp] Launching kernel: 'Python 3' with command: ['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-b26721de-573e-45cc-9c0c-c7ab3a14dcee.json']
[D 2020-12-02 14:31:33.605 EnterpriseGatewayApp] BaseProcessProxy.launch_process() env: {'PATH': 'C:\\Users\\Operator\\anaconda3\\envs\\gateway;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\mingw-w64\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\usr\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Scripts;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\bin;C:\\Users\\Operator\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\libnvvp;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\libnvvp;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\PharosSystems\\Core;C:\\ProgramData\\chocolatey\\bin;C:\\Program Files (x86)\\Wolfram Research\\WolframScript;C:\\Program Files\\nodejs;C:\\Program Files\\Git\\cmd;C:\\Program Files\\PuTTY;C:\\Program Files\\Amazon\\AWSCLIV2;C:\\bin;C:\\Program Files (x86)\\GnuPG\\bin;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\ProgramData\\DockerDesktop\\version-bin;C:\\Program Files\\NVIDIA Corporation\\NVIDIA NvDLISR;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\lib\\x64;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUPTI\\lib64;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32\\Scripts;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Operator\\AppData\\Roaming\\npm;C:\\Users\\Operator\\AppData\\Local\\atom\\bin;C:\\Users\\Operator\\AppData\\Local\\GitHubDesktop\\bin;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;.', 'SYSTEMROOT': 'C:\\WINDOWS', 'KERNEL_LAUNCH_TIMEOUT': '40', 'KERNEL_USERNAME': 'guest', 'KERNEL_WORKING_DIR': 'C:\\Users\\Operator', 'KERNEL_GATEWAY': '1', 'KERNEL_ID': 'b26721de-573e-45cc-9c0c-c7ab3a14dcee', 'KERNEL_LANGUAGE': 'python', 'EG_IMPERSONATION_ENABLED': 'False'}
[I 2020-12-02 14:31:33.619 EnterpriseGatewayApp] Local kernel launched on '10.0.0.193', pid: 37108, pgid: 0, KernelID: b26721de-573e-45cc-9c0c-c7ab3a14dcee, cmd: '['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-b26721de-573e-45cc-9c0c-c7ab3a14dcee.json']'
[D 2020-12-02 14:31:33.620 EnterpriseGatewayApp] Connecting to: tcp://127.0.0.1:50755
[D 2020-12-02 14:31:33.623 EnterpriseGatewayApp] Refreshing kernel session for id: b26721de-573e-45cc-9c0c-c7ab3a14dcee
Bad file descriptor (D:\bld\zeromq_1605919615529\work\src\epoll.cpp:100)
[I 2020-12-02 14:31:36.626 EnterpriseGatewayApp] AsyncIOLoopKernelRestarter: restarting kernel (2/5), new random ports
[D 2020-12-02 14:31:36.627 EnterpriseGatewayApp] BaseProcessProxy.terminate(): None
[D 2020-12-02 14:31:36.629 EnterpriseGatewayApp] Instantiating kernel 'Python 3' with process proxy: enterprise_gateway.services.processproxies.processproxy.LocalProcessProxy
[D 2020-12-02 14:31:36.632 EnterpriseGatewayApp] Starting kernel (async): ['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-b26721de-573e-45cc-9c0c-c7ab3a14dcee.json']
[D 2020-12-02 14:31:36.633 EnterpriseGatewayApp] Launching kernel: 'Python 3' with command: ['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-b26721de-573e-45cc-9c0c-c7ab3a14dcee.json']
[D 2020-12-02 14:31:36.633 EnterpriseGatewayApp] BaseProcessProxy.launch_process() env: {'PATH': 'C:\\Users\\Operator\\anaconda3\\envs\\gateway;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\mingw-w64\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\usr\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Scripts;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\bin;C:\\Users\\Operator\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\libnvvp;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\libnvvp;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\PharosSystems\\Core;C:\\ProgramData\\chocolatey\\bin;C:\\Program Files (x86)\\Wolfram Research\\WolframScript;C:\\Program Files\\nodejs;C:\\Program Files\\Git\\cmd;C:\\Program Files\\PuTTY;C:\\Program Files\\Amazon\\AWSCLIV2;C:\\bin;C:\\Program Files (x86)\\GnuPG\\bin;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\ProgramData\\DockerDesktop\\version-bin;C:\\Program Files\\NVIDIA Corporation\\NVIDIA NvDLISR;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\lib\\x64;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUPTI\\lib64;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32\\Scripts;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Operator\\AppData\\Roaming\\npm;C:\\Users\\Operator\\AppData\\Local\\atom\\bin;C:\\Users\\Operator\\AppData\\Local\\GitHubDesktop\\bin;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;.', 'SYSTEMROOT': 'C:\\WINDOWS', 'KERNEL_LAUNCH_TIMEOUT': '40', 'KERNEL_USERNAME': 'guest', 'KERNEL_WORKING_DIR': 'C:\\Users\\Operator', 'KERNEL_GATEWAY': '1', 'KERNEL_ID': 'b26721de-573e-45cc-9c0c-c7ab3a14dcee', 'KERNEL_LANGUAGE': 'python', 'EG_IMPERSONATION_ENABLED': 'False'}
[I 2020-12-02 14:31:36.638 EnterpriseGatewayApp] Local kernel launched on '10.0.0.193', pid: 30620, pgid: 0, KernelID: b26721de-573e-45cc-9c0c-c7ab3a14dcee, cmd: '['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-b26721de-573e-45cc-9c0c-c7ab3a14dcee.json']'
[D 2020-12-02 14:31:36.638 EnterpriseGatewayApp] Connecting to: tcp://127.0.0.1:50755
[D 2020-12-02 14:31:36.639 EnterpriseGatewayApp] Refreshing kernel session for id: b26721de-573e-45cc-9c0c-c7ab3a14dcee
Bad file descriptor (D:\bld\zeromq_1605919615529\work\src\epoll.cpp:100)
[I 2020-12-02 14:31:39.650 EnterpriseGatewayApp] AsyncIOLoopKernelRestarter: restarting kernel (3/5), new random ports
[D 2020-12-02 14:31:39.650 EnterpriseGatewayApp] BaseProcessProxy.terminate(): None
[D 2020-12-02 14:31:39.652 EnterpriseGatewayApp] Instantiating kernel 'Python 3' with process proxy: enterprise_gateway.services.processproxies.processproxy.LocalProcessProxy
[D 2020-12-02 14:31:39.655 EnterpriseGatewayApp] Starting kernel (async): ['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-b26721de-573e-45cc-9c0c-c7ab3a14dcee.json']
[D 2020-12-02 14:31:39.656 EnterpriseGatewayApp] Launching kernel: 'Python 3' with command: ['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-b26721de-573e-45cc-9c0c-c7ab3a14dcee.json']
[D 2020-12-02 14:31:39.656 EnterpriseGatewayApp] BaseProcessProxy.launch_process() env: {'PATH': 'C:\\Users\\Operator\\anaconda3\\envs\\gateway;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\mingw-w64\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\usr\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Scripts;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\bin;C:\\Users\\Operator\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\libnvvp;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\libnvvp;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\PharosSystems\\Core;C:\\ProgramData\\chocolatey\\bin;C:\\Program Files (x86)\\Wolfram Research\\WolframScript;C:\\Program Files\\nodejs;C:\\Program Files\\Git\\cmd;C:\\Program Files\\PuTTY;C:\\Program Files\\Amazon\\AWSCLIV2;C:\\bin;C:\\Program Files (x86)\\GnuPG\\bin;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\ProgramData\\DockerDesktop\\version-bin;C:\\Program Files\\NVIDIA Corporation\\NVIDIA NvDLISR;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\lib\\x64;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUPTI\\lib64;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32\\Scripts;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Operator\\AppData\\Roaming\\npm;C:\\Users\\Operator\\AppData\\Local\\atom\\bin;C:\\Users\\Operator\\AppData\\Local\\GitHubDesktop\\bin;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;.', 'SYSTEMROOT': 'C:\\WINDOWS', 'KERNEL_LAUNCH_TIMEOUT': '40', 'KERNEL_USERNAME': 'guest', 'KERNEL_WORKING_DIR': 'C:\\Users\\Operator', 'KERNEL_GATEWAY': '1', 'KERNEL_ID': 'b26721de-573e-45cc-9c0c-c7ab3a14dcee', 'KERNEL_LANGUAGE': 'python', 'EG_IMPERSONATION_ENABLED': 'False'}
[I 2020-12-02 14:31:39.661 EnterpriseGatewayApp] Local kernel launched on '10.0.0.193', pid: 31808, pgid: 0, KernelID: b26721de-573e-45cc-9c0c-c7ab3a14dcee, cmd: '['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-b26721de-573e-45cc-9c0c-c7ab3a14dcee.json']'
[D 2020-12-02 14:31:39.661 EnterpriseGatewayApp] Connecting to: tcp://127.0.0.1:50755
[D 2020-12-02 14:31:39.663 EnterpriseGatewayApp] Refreshing kernel session for id: b26721de-573e-45cc-9c0c-c7ab3a14dcee
Bad file descriptor (D:\bld\zeromq_1605919615529\work\src\epoll.cpp:100)
[I 2020-12-02 14:31:42.650 EnterpriseGatewayApp] AsyncIOLoopKernelRestarter: restarting kernel (4/5), new random ports
[D 2020-12-02 14:31:42.650 EnterpriseGatewayApp] BaseProcessProxy.terminate(): None
[D 2020-12-02 14:31:42.653 EnterpriseGatewayApp] Instantiating kernel 'Python 3' with process proxy: enterprise_gateway.services.processproxies.processproxy.LocalProcessProxy
[D 2020-12-02 14:31:42.656 EnterpriseGatewayApp] Starting kernel (async): ['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-b26721de-573e-45cc-9c0c-c7ab3a14dcee.json']
[D 2020-12-02 14:31:42.659 EnterpriseGatewayApp] Launching kernel: 'Python 3' with command: ['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-b26721de-573e-45cc-9c0c-c7ab3a14dcee.json']
[D 2020-12-02 14:31:42.660 EnterpriseGatewayApp] BaseProcessProxy.launch_process() env: {'PATH': 'C:\\Users\\Operator\\anaconda3\\envs\\gateway;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\mingw-w64\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\usr\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Library\\bin;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\Scripts;C:\\Users\\Operator\\anaconda3\\envs\\gateway\\bin;C:\\Users\\Operator\\anaconda3\\condabin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v10.0\\libnvvp;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\bin;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\libnvvp;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Windows\\System32;C:\\Windows;C:\\Windows\\System32\\wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0;C:\\Windows\\System32\\OpenSSH;C:\\Program Files (x86)\\PharosSystems\\Core;C:\\ProgramData\\chocolatey\\bin;C:\\Program Files (x86)\\Wolfram Research\\WolframScript;C:\\Program Files\\nodejs;C:\\Program Files\\Git\\cmd;C:\\Program Files\\PuTTY;C:\\Program Files\\Amazon\\AWSCLIV2;C:\\bin;C:\\Program Files (x86)\\GnuPG\\bin;C:\\Program Files\\Docker\\Docker\\resources\\bin;C:\\ProgramData\\DockerDesktop\\version-bin;C:\\Program Files\\NVIDIA Corporation\\NVIDIA NvDLISR;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.0\\lib\\x64;C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUPTI\\lib64;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32\\Scripts;C:\\Users\\Operator\\AppData\\Local\\Programs\\Python\\Python38-32;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\Operator\\AppData\\Roaming\\npm;C:\\Users\\Operator\\AppData\\Local\\atom\\bin;C:\\Users\\Operator\\AppData\\Local\\GitHubDesktop\\bin;C:\\Users\\Operator\\AppData\\Local\\Microsoft\\WindowsApps;.', 'SYSTEMROOT': 'C:\\WINDOWS', 'KERNEL_LAUNCH_TIMEOUT': '40', 'KERNEL_USERNAME': 'guest', 'KERNEL_WORKING_DIR': 'C:\\Users\\Operator', 'KERNEL_GATEWAY': '1', 'KERNEL_ID': 'b26721de-573e-45cc-9c0c-c7ab3a14dcee', 'KERNEL_LANGUAGE': 'python', 'EG_IMPERSONATION_ENABLED': 'False'}
[I 2020-12-02 14:31:42.665 EnterpriseGatewayApp] Local kernel launched on '10.0.0.193', pid: 27656, pgid: 0, KernelID: b26721de-573e-45cc-9c0c-c7ab3a14dcee, cmd: '['C:/Users/Operator/anaconda3/envs/gateway\\python.exe', '-m', 'ipykernel_launcher', '-f', 'C:\\Users\\Operator\\AppData\\Roaming\\jupyter\\runtime\\kernel-b26721de-573e-45cc-9c0c-c7ab3a14dcee.json']'
[D 2020-12-02 14:31:42.665 EnterpriseGatewayApp] Connecting to: tcp://127.0.0.1:50755
[D 2020-12-02 14:31:42.667 EnterpriseGatewayApp] Refreshing kernel session for id: b26721de-573e-45cc-9c0c-c7ab3a14dcee
Bad file descriptor (D:\bld\zeromq_1605919615529\work\src\epoll.cpp:100)
[W 2020-12-02 14:31:45.675 EnterpriseGatewayApp] AsyncIOLoopKernelRestarter: restart failed
[W 2020-12-02 14:31:45.675 EnterpriseGatewayApp] Kernel b26721de-573e-45cc-9c0c-c7ab3a14dcee died, removing from map.
Bad file descriptor (D:\bld\zeromq_1605919615529\work\src\epoll.cpp:100)
and may have something to do with file cleanup by Python. I have no idea why Python would be trying to create and clean up files in my data drive, though.
Theses are zmq sockets getting cleaned up (per the linked issue) where their closing is likely the responsibility of code in the jupyter_client package. The file referenced int he Bad file descriptor message is the source code that is encounter the bad file descriptor (associated with a socket).
What's strange is that you're running a LocalProcessProxy as evidenced by this log entry:
[D 2020-12-02 14:31:36.629 EnterpriseGatewayApp] Instantiating kernel 'Python 3' with process proxy: enterprise_gateway.services.processproxies.processproxy.LocalProcessProxy
and the LocalProcessProxy is really nothing more than a pass-thru to the regular code in jupyter_client. I'd be curious if you see similar behaviors running the same notebook w/o using the --gateway-url option when starting the notebook server. (Just be sure the notebook server is invoked in the same environment in which you're currently attempting to run EG.)
I'm happy to work with you more on getting EG operational on Windows, too, depending on whether you want to support Windows in the future.
Since I believe you might be the first to go down the Windows road, it might be worthwhile attempting to understand what are actual issues vs. what might be environmental/configuration-related. But that's completely up to you since I don't really have a system to try things out on (although I can probably get one provisioned from my employer for a time being).
Given your primary target is Kubernetes and since EG needs to run in a pod, it's probably not really worth your time going down this road (although I think we should probably perform the test of running a straight notebook server in the EG env).
Thanks.
Yes, the standard notebook runs fine in this environment
(gateway) C:\Users\Operator>jupyter notebook --port=7000
and the port doesn't matter.
I probably will poke at this issue a bit more from time to time. I agree with you that getting a better sense of what the issues with Windows are and where they arise may be valuable, and EG seems like a useful enough project that I'm happy to help!
Hi @averageflamethrowerguy - although I'm afraid to ask (:smile:) have you made any progress on this for Windows?
The fear is justified. No progress. I'm also no longer at the company where I was using EG stuff, so I doubt I'll touch this again. Sorry!
No worries Elliot. That Help Wanted label should do the trick! Good luck at your new gig.