autonose IPC fails with RemoteError / KeyError

[timbertson]

from @teleyinex's comment to issue #13

full log at http://paste.ubuntu.com/943730/, reproduced here for longevity:

Traceback (most recent call last):
  File "/home/teleyinex/Proyectos/PyBossa/pybossa/env/lib/python2.6/site-packages/paragram/process/base_process.py", line 254, in _receive
    handler(*args)
  File "/home/teleyinex/Proyectos/PyBossa/pybossa/env/lib/python2.6/site-packages/paragram/process/base_process.py", line 202, in _exit_handler
    self.send(Exit(UnhandledChildExit(proc)))
  File "/home/teleyinex/Proyectos/PyBossa/pybossa/env/lib/python2.6/site-packages/paragram/process/base_process.py", line 142, in send
    _send(self._queue, *msg)
  File "/home/teleyinex/Proyectos/PyBossa/pybossa/env/lib/python2.6/site-packages/paragram/process/base_process.py", line 52, in _send
    queue.put(pickle.dumps(msg))
  File "<string>", line 2, in put
  File "/usr/lib/python2.6/multiprocessing/managers.py", line 740, in _callmethod
    raise convert_to_error(kind, result)
RemoteError: 
---------------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.6/multiprocessing/managers.py", line 216, in serve_client
    obj, exposed, gettypeid = id_to_obj[ident]
KeyError: 'b7001b8c'
---------------------------------------------------------------------------
Exception in thread state-saver:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/home/teleyinex/Proyectos/PyBossa/pybossa/env/lib/python2.6/site-packages/paragram/process/base_process.py", line 217, in _run
    self._exit(e.error)
  File "/home/teleyinex/Proyectos/PyBossa/pybossa/env/lib/python2.6/site-packages/paragram/process/base_process.py", line 235, in _exit
    self._finished.set()
  File "/usr/lib/python2.6/multiprocessing/managers.py", line 977, in set
    return self._callmethod('set')
  File "/usr/lib/python2.6/multiprocessing/managers.py", line 740, in _callmethod
    raise convert_to_error(kind, result)
RemoteError: 
---------------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.6/multiprocessing/managers.py", line 216, in serve_client
    obj, exposed, gettypeid = id_to_obj[ident]
KeyError: 'b70033ec'
---------------------------------------------------------------------------

Exception in thread basic UI:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/home/teleyinex/Proyectos/PyBossa/pybossa/env/lib/python2.6/site-packages/paragram/process/base_process.py", line 217, in _run
    self._exit(e.error)
  File "/home/teleyinex/Proyectos/PyBossa/pybossa/env/lib/python2.6/site-packages/paragram/process/base_process.py", line 235, in _exit
    self._finished.set()
  File "/usr/lib/python2.6/multiprocessing/managers.py", line 977, in set
    return self._callmethod('set')
  File "/usr/lib/python2.6/multiprocessing/managers.py", line 740, in _callmethod
    raise convert_to_error(kind, result)
RemoteError: 
---------------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.6/multiprocessing/managers.py", line 216, in serve_client
    obj, exposed, gettypeid = id_to_obj[ident]
KeyError: 'b7001e6c'
---------------------------------------------------------------------------

I have experienced this problem myself, but I'm afraid I have no idea what it is - it seems to be deep in the bowels of the multiprocessing inter-process communication, and is likely due to an upgrade to python or its libraries (since it never used to happen). But that's about all I know.

[npdoty]

Any suggested workarounds? I'm getting this issue now too and find it hard to diagnose or debug.

[timbertson]

I'm afraid not, I haven't done any work on (or really used) autonose for a while, so l haven't really looked into it any further (and to be honest, I'm not really sure where to start). Patches most certainly welcome, if you can figure it out :/