s3fs icon indicating copy to clipboard operation
s3fs copied to clipboard

RecursionError maximum recursion depth exceeded

Open geoffjukes opened this issue 5 years ago • 2 comments
trafficstars

Hi,

I nuked one of my servers and let everything build from scratch. Unfortunately some combination of the packages below causes s3fs to throw a RecursionError maximum recursion depth exceeded when being called using the URL opener.

I honestly haven't tried any other way, as I don't do it that way (happy to test though).

Try as I might, I cannot get Sentry to log the exception, so I'm kinda fumbling around in the dark. Any pointers would be gratefully received!

Many thanks,

Geoff

amqp==2.6.0
appdirs==1.4.4
boto3==1.14.31
botocore==1.17.31
certifi==2020.6.20
chardet==3.0.4
dnspython==2.0.0
docutils==0.15.2
eventlet==0.25.2
fs==2.4.11
fs-s3fs==1.1.1
greenlet==0.4.16
idna==2.10
importlib-metadata==1.7.0
jmespath==0.10.0
kombu==4.6.11
mock==4.0.2
monotonic==1.5
mutagen==1.41.1
nameko==2.12.0
nameko-sentry==1.0.0
path==15.0.0
path.py==12.5.0
pkg-resources==0.0.0
psutil==5.7.2
python-dateutil==2.8.1
pytz==2020.1
PyYAML==5.3.1
raven==6.10.0
requests==2.24.0
s3transfer==0.3.3
scout-apm==2.6.1
six==1.15.0
urllib3==1.25.10
vine==1.3.0
vosk==0.3.10
Werkzeug==1.0.1
wrapt==1.12.1
zipp==3.1.0

geoffjukes avatar Jul 31 '20 01:07 geoffjukes

I used another service as a reference and downgraded everything to match. The combination below works just fine:

amqp==2.5.2
appdirs==1.4.3
boto3==1.9.41
botocore==1.12.253
certifi==2019.11.28
chardet==3.0.4
dnspython==1.16.0
docutils==0.15.2
eventlet==0.25.1
fs==2.4.11
fs-s3fs==1.1.1
greenlet==0.4.15
idna==2.8
importlib-metadata==1.5.0
jmespath==0.9.4
kombu==4.6.7
mock==3.0.5
monotonic==1.5
mutagen==1.41.1
nameko==2.12.0
nameko-sentry==1.0.0
path==13.1.0
path.py==12.4.0
pkg-resources==0.0.0
psutil==5.6.7
python-dateutil==2.8.1
pytz==2019.3
PyYAML==5.3
raven==6.10.0
requests==2.22.0
s3transfer==0.1.13
scout-apm==2.6.1
six==1.14.0
urllib3==1.25.8
vine==1.3.0
vosk==0.3.10
Werkzeug==0.16.1
wrapt==1.11.2
zipp==2.1.0

geoffjukes avatar Jul 31 '20 02:07 geoffjukes

Sorry, nothing comes to mind. There doesn't seem to be anything in the opener itself that could get stuck in a loop. You could try using sys.setrecursionlimit to something a lot lower, that might it easier for Sentry to handle.

willmcgugan avatar Jul 31 '20 08:07 willmcgugan