worker.py does not execute in example

[BBischof]

The ./run_worker.sh fails with exit code 1(seemingly from _check_process_resources) when I try to run the included example.

[Stovoy]

Could you see if it's running out of memory? There should be a log saying it ran over 256mb. If that's the case, a simple fix would be increasing DIE_ON_RESIDENT_SET_SIZE_MB to 512mb in default_settings.py.

It's curious that it's happening for you though. I haven't been able to reproduce when running in a clean environment: docker run -it --entrypoint bash python -c 'git clone https://github.com/Nextdoor/ndkale && cd ndkale && python setup.py install && cd example && ./run_worker.sh'

Could you do pip freeze and see what libraries are in your environment? It should be:

$ pip freeze
appdirs==1.4.3
boto==2.46.1
future==0.16.0
ndkale==0.3.0
packaging==16.8
pycrypto==2.6.1
pyparsing==2.2.0
PyYAML==3.12
six==1.10.0

It's possible that different versions of Python / Libraries use more memory, so that's my hunch right now. I'd recommend setting up a virtual environment for ndkale to test that.

[BBischof]

Is there somewhere specific that I should be looking for this log output? It's writing at info level(and I didn't see anywhere to specify to the library what log level to use).

Currently running all of this in a virtual environment.

Here's my pip freeze:

appdirs==1.4.3
boto==2.46.1
future==0.16.0
ndkale==0.3.0
packaging==16.8
pycrypto==2.6.1
pymongo==3.4.0
pyparsing==2.2.0
PyYAML==3.12
six==1.10.0

[BBischof]

Also, I increased the DIE_ON_RESIDENT_SET_SIZE_MB just in case—no dice.