etherscan-labels icon indicating copy to clipboard operation
etherscan-labels copied to clipboard

Published 20 hours ago • verified publisher icon brianleect

Automation for generating the file on a nightly basis?

Open travisbotello opened this issue 2 years ago • 1 comments

Hey there! Many thanks for this awesome script. Is it somehow possible auto generate those files every night and add it to this github repo? For example like: https://github.com/sapics/ip-location-db

travisbotello avatar Jan 22 '23 08:01 travisbotello

Hmm I'm not too sure tbh since there's heavy reliance on logging in via etherscan first using selenium.

Main challenge would be

  • Clearing Captcha + automation for etherscan login

Alternative I suppose could be to leave an instance logged in running and simply scrape everything from the last pages of each recorded column.

Not sure about the compute costs though and perhaps a soln that relies on attaching cookies https://github.com/brianleect/etherscan-labels/issues/9 would be much more efficient or a completely separate library used to controlling browser scraping might be better?

brianleect avatar Jan 25 '23 11:01 brianleect