jupyterlab-hub
jupyterlab-hub copied to clipboard
Preventing implicit spawn for user because last spawn failed
Since half a year, we use successfully jupyterlab-hub for 3 users. USER tried to install a package (through !pip install ..., in the notebook) and now only USER can't connect. He gets 500 errors.

This is what we can get from the logs:
E 2019-05-21 12:44:33.742 JupyterHub base:1001] Preventing implicit spawn for USER because last spawn failed: 'pid'
[E 2019-05-21 12:44:33.743 JupyterHub web:1670] Uncaught exception GET /hub/user/USER/ (::ffff:IP)
HTTPServerRequest(protocol='http', host='IP, method='GET', uri='/hub/user/USER/', version='HTTP/1.1', remote_ip='::ffff:IP')
Traceback (most recent call last):
File "/usr/local/lib/python3.5/dist-packages/tornado/web.py", line 1592, in _execute
result = yield result
File "/usr/lib/python3.5/asyncio/futures.py", line 293, in result
raise self._exception
File "/usr/lib/python3.5/asyncio/tasks.py", line 239, in _step
result = coro.send(None)
File "/usr/local/lib/python3.5/dist-packages/jupyterhub/handlers/base.py", line 1003, in get
raise copy.copy(exc).with_traceback(exc.__traceback__)
File "/usr/local/lib/python3.5/dist-packages/tornado/web.py", line 1592, in _execute
result = yield result
File "/usr/lib/python3.5/asyncio/futures.py", line 293, in result
raise self._exception
File "/usr/lib/python3.5/asyncio/tasks.py", line 241, in _step
result = coro.throw(exc)
File "/usr/local/lib/python3.5/dist-packages/jupyterhub/handlers/base.py", line 1052, in get
await self.spawn_single_user(user)
File "/usr/local/lib/python3.5/dist-packages/jupyterhub/handlers/base.py", line 705, in spawn_single_user
timedelta(seconds=self.slow_spawn_timeout), finish_spawn_future
File "/usr/lib/python3.5/asyncio/futures.py", line 380, in __iter__
yield self # This tells Task to wait for completion.
File "/usr/lib/python3.5/asyncio/tasks.py", line 304, in _wakeup
future.result()
File "/usr/lib/python3.5/asyncio/futures.py", line 293, in result
raise self._exception
File "/usr/lib/python3.5/asyncio/tasks.py", line 239, in _step
result = coro.send(None)
File "/usr/local/lib/python3.5/dist-packages/jupyterhub/handlers/base.py", line 626, in finish_user_spawn
await spawn_future
File "/usr/local/lib/python3.5/dist-packages/jupyterhub/user.py", line 489, in spawn
raise e
File "/usr/local/lib/python3.5/dist-packages/jupyterhub/user.py", line 409, in spawn
url = await gen.with_timeout(timedelta(seconds=spawner.start_timeout), f)
File "/usr/lib/python3.5/asyncio/futures.py", line 380, in __iter__
yield self # This tells Task to wait for completion.
File "/usr/lib/python3.5/asyncio/tasks.py", line 304, in _wakeup
future.result()
File "/usr/lib/python3.5/asyncio/futures.py", line 293, in result
raise self._exception
File "/usr/local/lib/python3.5/dist-packages/sudospawner/spawner.py", line 93, in start
self.pid = reply['pid']
KeyError: 'pid'
How to solve this issue? Is it possible to reset server configuration for one user only? I tried to restart the server multiple times, fix package installed, the server is unusable for only one user.