spiderfoot
spiderfoot copied to clipboard
Published
20 hours ago •
smicallef
smicallef
[BUG] Docker v3.0/v3.1 | "Fatal Python error: Cannot recover from stack overflow" when running scan on IP with investigate or higher
Environment:
- docker running v3.0 or v3.1 (dc543da32c7277970d0a68ce6cc24ce6a58eaf52) from here https://github.com/smicallef/spiderfoot/blob/master/Dockerfile
- reverse proxy nginx
what i do
create new scan with use case "Investigate" or higher on an IP, e.g. this one https://urlhaus.abuse.ch/url/306802/ (42.239.145[.]17)
what does happen
The scan starts, but after some time it crashes with the following error:
Feb 03 12:45:21 dev 35781e8f4ee8[584]: Fatal Python error: Cannot recover from stack overflow.
Feb 03 12:45:21 dev 35781e8f4ee8[584]: Python runtime state: initialized
Feb 03 12:45:21 dev 35781e8f4ee8[584]:
Feb 03 12:45:21 dev 35781e8f4ee8[584]: Current thread 0x00007fba5e784b20 (most recent call first):
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/email/utils.py", line 57 in _has_surrogates
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/email/_policybase.py", line 287 in _sanitize_header
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/email/_policybase.py", line 316 in header_fetch_parse
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/email/message.py", line 471 in get
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/email/message.py", line 578 in get_content_type
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/email/message.py", line 594 in get_content_maintype
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/email/feedparser.py", line 295 in _parsegen
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/email/feedparser.py", line 180 in _call_parse
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/email/feedparser.py", line 176 in feed
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/email/parser.py", line 56 in parse
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/email/parser.py", line 67 in parsestr
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/http/client.py", line 221 in parse_headers
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/http/client.py", line 327 in begin
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/http/client.py", line 1322 in getresponse
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 416 in _make_request
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 665 in urlopen
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/site-packages/requests/adapters.py", line 439 in send
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 646 in send
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 533 in request
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 546 in get
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1436 in fetchUrl
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_abuseipdb.py", line 110 in resourceQuery
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_abuseipdb.py", line 138 in lookupItem
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_abuseipdb.py", line 179 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/home/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 03 12:45:21 dev 35781e8f4ee8[584]: ...
Feb 03 12:45:21 dev 35781e8f4ee8[584]:
Feb 03 12:45:21 dev 35781e8f4ee8[584]: Thread 0x00007fba5e947b20 (most recent call first):
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 03 12:45:21 dev 35781e8f4ee8[584]:
Feb 03 12:45:21 dev 35781e8f4ee8[584]: Thread 0x00007fba5ea4ab20 (most recent call first):
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 03 12:45:21 dev 35781e8f4ee8[584]:
Feb 03 12:45:21 dev 35781e8f4ee8[584]: Thread 0x00007fba5eb4db20 (most recent call first):
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 03 12:45:21 dev 35781e8f4ee8[584]:
Feb 03 12:45:21 dev 35781e8f4ee8[584]: Thread 0x00007fba5ec50b20 (most recent call first):
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 03 12:45:21 dev 35781e8f4ee8[584]:
Feb 03 12:45:21 dev 35781e8f4ee8[584]: Thread 0x00007fba5ed53b20 (most recent call first):
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 03 12:45:21 dev 35781e8f4ee8[584]:
Feb 03 12:45:21 dev 35781e8f4ee8[584]: Thread 0x00007fba5ee56b20 (most recent call first):
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 03 12:45:21 dev 35781e8f4ee8[584]:
Feb 03 12:45:21 dev 35781e8f4ee8[584]: Thread 0x00007fba5ef59b20 (most recent call first):
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 03 12:45:21 dev 35781e8f4ee8[584]:
Feb 03 12:45:21 dev 35781e8f4ee8[584]: Thread 0x00007fba5f05cb20 (most recent call first):
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 03 12:45:21 dev 35781e8f4ee8[584]:
Feb 03 12:45:21 dev 35781e8f4ee8[584]: Thread 0x00007fba5f15fb20 (most recent call first):
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 03 12:45:21 dev 35781e8f4ee8[584]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
what should happen
scan should not crash
I am also seeing this, but I am running on v3.0-final without docker, no virtualenv.
Feb 19 15:26:37 localhost python[2018]: Fatal Python error: Cannot recover from stack overflow.
Feb 19 15:26:37 localhost python[2018]: Python runtime state: initialized
Feb 19 15:26:37 localhost python[2018]: Current thread 0x00007f67ae4fc700 (most recent call first):
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/email/utils.py", line 57 in _has_surrogates
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/email/_policybase.py", line 287 in _sanitize_header
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/email/_policybase.py", line 316 in header_fetch_parse
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/email/message.py", line 471 in get
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/email/message.py", line 578 in get_content_type
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/email/feedparser.py", line 256 in _parsegen
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/email/feedparser.py", line 180 in _call_parse
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/email/feedparser.py", line 176 in feed
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/email/parser.py", line 56 in parse
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/email/parser.py", line 67 in parsestr
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/http/client.py", line 221 in parse_headers
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/http/client.py", line 327 in begin
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/http/client.py", line 1322 in getresponse
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 416 in _make_request
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 665 in urlopen
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/requests/adapters.py", line 439 in send
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 646 in send
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 533 in request
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 546 in get
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1436 in fetchUrl
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_bgpview.py", line 100 in queryIp
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_bgpview.py", line 236 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/sflib.py", line 1783 in notifyListeners
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 184 in processHost
Feb 19 15:26:37 localhost python[2018]: File "/opt/spiderfoot/modules/sfp_dnsneighbor.py", line 118 in handleEvent
Feb 19 15:26:37 localhost python[2018]: ...
Feb 19 15:26:37 localhost python[2018]: Thread 0x00007f67aeffd700 (most recent call first):
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 19 15:26:37 localhost python[2018]: Thread 0x00007f67af7fe700 (most recent call first):
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 19 15:26:37 localhost python[2018]: Thread 0x00007f67affff700 (most recent call first):
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 19 15:26:37 localhost python[2018]: Thread 0x00007f67ccbb7700 (most recent call first):
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 19 15:26:37 localhost python[2018]: Thread 0x00007f67cd3b8700 (most recent call first):
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 19 15:26:37 localhost python[2018]: Thread 0x00007f67cdbb9700 (most recent call first):
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 19 15:26:37 localhost python[2018]: Thread 0x00007f67ce3ba700 (most recent call first):
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 19 15:26:37 localhost python[2018]: Thread 0x00007f67cebbb700 (most recent call first):
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 19 15:26:37 localhost python[2018]: Thread 0x00007f67cf3bc700 (most recent call first):
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 19 15:26:37 localhost python[2018]: Thread 0x00007f67cfbbd700 (most recent call first):
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 302 in wait
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/queue.py", line 170 in get
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cheroot/workers/threadpool.py", line 110 in run
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 19 15:26:37 localhost python[2018]: Thread 0x00007f67d03be700 (most recent call first):
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cheroot/connections.py", line 142 in get_conn
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cheroot/server.py", line 1993 in tick
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cheroot/server.py", line 1770 in serve
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cheroot/server.py", line 1796 in start
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cherrypy/process/servers.py", line 225 in _start_http_thread
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 870 in run
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap
Feb 19 15:26:37 localhost python[2018]: Thread 0x00007f67d7154740 (most recent call first):
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cherrypy/process/wspbus.py", line 376 in wait
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cherrypy/process/wspbus.py", line 336 in block
Feb 19 15:26:37 localhost python[2018]: File "/usr/lib/python3.8/site-packages/cherrypy/__init__.py", line 178 in quickstart
Feb 19 15:26:37 localhost python[2018]: File "sf.py", line 440 in <module>
Feb 19 15:26:40 localhost systemd[1]: spiderfoot.service: Main process exited, code=killed, status=6/ABRT
Are you seeing this with the latest version as well? It could be due to a module stuck in a loop consuming its own events.
Are you seeing this with the latest version as well? It could be due to a module stuck in a loop consuming its own events.
'fraid so. I can make it do it fairly reliably, if there's anything that needs testing...
