curdling [Segmentation Fault]: curd install -r requirements.txt

When I run curd install -r requirements.txt on my requirements during the installation phase curd is stuck (Sl+ state in ps IIRC)

And if I ctrl+c the process I get a Segmentation Fault

Probably this output is not sufficient, but I am sharing it just to make it a little bit more visible in this Issue:

2013-11-15 16:38:10,855:distlib.util:INFO:Copying stream <zipfile.ZipExtFile object at 0x7fc7e80adcd0> to /tmp/tmpnoNNg4/django-admin.py
2013-11-15 16:38:10,855:distlib.scripts:INFO:copying and adjusting /tmp/tmpnoNNg4/django-admin.py -> /home/marco/.virtualenvs/curdling/bin
2013-11-15 16:38:10,856:distlib.util:INFO:changing mode of /home/marco/.virtualenvs/curdling/bin/django-admin.py to 755
2013-11-15 16:38:10,856:distlib.util:INFO:Copying stream <zipfile.ZipExtFile object at 0x7fc7e80adcd0> to /home/marco/.virtualenvs/curdling/lib/python2.7/site-packages/Django-1.3.7.dist-info/DESCRIPTION.rst
2013-11-15 16:38:10,857:distlib.util:INFO:Copying stream <zipfile.ZipExtFile object at 0x7fc7e80adcd0> to /home/marco/.virtualenvs/curdling/lib/python2.7/site-packages/Django-1.3.7.dist-info/pydist.json
2013-11-15 16:38:10,857:distlib.util:INFO:Copying stream <zipfile.ZipExtFile object at 0x7fc7e80adcd0> to /home/marco/.virtualenvs/curdling/lib/python2.7/site-packages/Django-1.3.7.dist-info/top_level.txt
2013-11-15 16:38:10,858:distlib.util:INFO:Copying stream <zipfile.ZipExtFile object at 0x7fc7cc2464d0> to /home/marco/.virtualenvs/curdling/lib/python2.7/site-packages/Django-1.3.7.dist-info/METADATA
2013-11-15 16:38:10,860:distlib.database:INFO:creating /home/marco/.virtualenvs/curdling/lib/python2.7/site-packages/Django-1.3.7.dist-info/SHARED
2013-11-15 16:38:10,860:distlib.database:INFO:creating /home/marco/.virtualenvs/curdling/lib/python2.7/site-packages/Django-1.3.7.dist-info/RECORD
Installing: [######### ] 98% (110/112)2013-11-15 16:38:11,632:curdling.services.base:DEBUG:installer[Thread-6].run(data="{'wheel': u'/home/marco/.curds/Django-1.3.7-py27-none-any.whl', 'requirement': u'django (1.3.7)'}"): {'wheel': u'/home/marco/.curds/Django-1.3.7-py27-none-any.whl', 'requirement': u'django (1.3.7)'}
Installing: [######### ] 99% (111/112)^CSegmentation fault (core dumped)

Nov 15 '13 15:11 kpanic

Hi @kpanic, how's it going? Can you tell me which version of curdling you're running? Django is a kind of a big packages with lots of files to be extracted from the zip file so it is supposed to take longer than other regular packages.

About the segfault, are you able to reproduce this bug whenever you run curdling? If so, maybe you could help me getting the traceback from the OS by executing the following command before running curdling:

 $ ulimit -c unlimited

If you're running on a GNU/Linux box, the file will be generated in your current $PWD, if it's a Mac OS X, it will be generated in the /cores folder. I'd cleanup that folder before running this command to ensure it's the right file (sudo rm -rf /cores/*)

Nov 15 '13 19:11 clarete

Dear @clarete all is going well thanks :) I'm running the latest master, commit 864313157e4f0966a32f24fae4e525de71ce435c

I sent you an email but with the core file already and an strace, but I think you have problems with your MTA :( If you can provide a functional email I can send to you the core directly :) Thanks man for the continuous support!

BTW, I'm running under the latest stable Ubuntu

Nov 15 '13 20:11 kpanic

Hey @clarete I sent you the core file via email. You should have the email I think. Any news about this issue? Thanks :)

Nov 19 '13 10:11 kpanic

Hi @clarete I updated my curdling git version up to 0eb925d3b46b8112289072fa793b563b00568a5a and I got this error (which was not appearing before):

curd install -r requirements.txt
Installing: [######### ] 99% (113/114 - 1 failed)
Some milk was spilled in the process:
uwsgi
 * uwsgi (1.9.9) explicit requirement: SyntaxError:
     invalid or missing encoding declaration for u'/tmp/tmpRXNK9i/uwsgi'
Segmentation fault (core dumped)

Maybe it helps to diagnose the segfault! Can be reproduced also (without the segfault) just by executing:

curd install uwsgi==1.9.9
Installing: [          ]  0% (0/1 - 1 failed)
Some milk was spilled in the process:
uwsgi
 * uwsgi (1.9.9) explicit requirement: SyntaxError:
     invalid or missing encoding declaration for u'/tmp/tmp_HT8fc/uwsgi'

Thanks

Dec 03 '13 09:12 kpanic

Hey man, that's actually a good sign. I've been hunting the initial bug and I feel like it's fixed. Now there's still something else to fix in distlib (a dependency of curdling). Thanks for the feedback!

Dec 05 '13 20:12 clarete

Hey @clarete I will try the latest fix to distlib when it will be ready and let you know how it will go the "segfault" issue. Let's keep this issue open for now, if you agree ;) Thanks

Dec 05 '13 21:12 kpanic

For sure! I might work on it this weekend! Thank you!

Dec 05 '13 21:12 clarete

Any news about this? i've the same issue.

Jan 27 '14 14:01 qrees

@qrees I tried to update from master, same result (with core). I am also still stuck on this issue before trying to use curd :)

Jan 27 '14 14:01 kpanic

There's actually good news about that folks! I've been working on my own implementation of the wheel format! I found a few other bugs related to the implementation present in distlib. It will take a little longer to fix but it will be worth it! :)

Jan 28 '14 15:01 clarete