How to make this script fast ?

[whatneuron]

Downloading 100 images take about 10 minutes on a fast internet connection, any idea how to make it fast ? thanks

[LorenzoPinto04]

To be honest being a scraper the script is kinda fast. I think the problem is related to your setup, because for 100 images doesn't take more than 1-2 minutes in my case.

[whatneuron]

@lorenzo how you doing it ?

[LorenzoPinto04]

Hi! Everything fine! You?

Lorenzo

Il giorno 1 ott 2019, alle ore 01:20, whatneuron <[email protected]mailto:[email protected]> ha scritto:

@lorenzohttps://github.com/lorenzo how you doing it ?

— You are receiving this because you commented. Reply to this email directly, view it on GitHubhttps://github.com/hardikvasa/google-images-download/issues/269?email_source=notifications&email_token=AKISYG7MXK7KQUM32LCJT53QMKCTBA5CNFSM4IY5OJC2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD77MT2A#issuecomment-536791528, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AKISYG7Q44QVRXS3XQDZUI3QMKCTBANCNFSM4IY5OJCQ.

[whatneuron]

great, can i see your implementation of code as it's slow for me

[D3MZ]

AFIK: Try thumbnails only as they're pulled from google directly. Where as the full images are dependent on the actual websites you're pulling from.

If thumbnails are fast, then lower the socket_timeout argument to be less than the default of 10 seconds.