Cooper Lees
Cooper Lees
`>= aiohttp 3.9.0b1` seems to work now. But we hit an issue with s3path which needs a lot of refactoring for 3.12 - Seems to be tracked here: https://github.com/liormizr/s3path/issues/149
Howdy, This isn't really a bandersnatch question. This is all a limitation of lots of small files on your storage backend. The only ideas we could possibly try: - Use...
Awesome. Yeah I’ll be surprised if it’s much faster and will be hard to get accurate without checking if the files exist, which is the expensive part. It might surprise...
verify was never tested for anything other than standard POSIX file systems. For non POSIX, I'm open to many ideas. I'm happy to add checkpointing support to verify as a...
My other thought is using tables in a sqllite database maybe for the state. Comitting using something like [aiosqlite](https://github.com/omnilib/aiosqlite) as you go moving from a simple todo and done table....
Howdy. Sorry to hear you troubles. You've taken the brute force attempt to fix your errors! But this is dedication (17 days verify ...). I haven't ran a verify since...
So the verify seems to be getting a lot of connection errors and timeouts - What kind of internet connection are you running bandersnatch on? It would be nice to...
Sadly, the only options now are very expensive. They are: - `bandernatch mirror --force-check` - This will do a full sync and check every pacakge from PyPI - If you...
This has been a long term CDN problem with warehouse. There is an issue open you could comment on, both for us and warehouse. ``` bandersnatch.master.StalePage: Expected PyPI serial 20485085...
Yup, the PyPI Index is over 14T now. https://pypi.org/stats/ We do not have a predefined list of commonly used plugins. I'd be open to adding some more examples or lists...