Allen Day

we need to understand from @volsa how new contract addresses / URLs can be added to the scraper queue

it's also possible to reduce the amount of scraping needed by looking at the contract creation bytes, because identical bytes will always produce identical contracts regardless of the address. ```sql...

Regarding the NULL fields referred to in (1), would it be acceptable in the short term to define a NULL token, like `` and insert this instead? It could be...

Regarding (3), here's where we need to detect the 404 as an alternate block: https://github.com/volsa/etherface/blob/master/etherface/src/scraper/etherscan.rs#L28

Regarding (2), and also in relation to: - github scraping, and - https://github.com/volsa/etherface/issues/10 I propose adding a new table for storing contract source code. It looks like etherscan API only...

> Would this table have any mappings to other tables? In the spirit of etherface as an operational DB, I'd make the source code linked to `etherscan_contract.address` as a FK....

> Since we would store the source code in the database anyway, there is nothing stopping us from also storing its hashed bytecode; out of curiosity how would we off-load...

That's great, my thinking is that the easiest will be to coordinate with a regular dump as the intermediary, probably using DBT in a GCP Cloud Build CI/CD.

Yes, we can add some metadata linking to the project. Given there are upstream sources that also need attribution, would you be ok with having a new page and top...

Yes exactly. Not architecture but exec summary and how to cite. We will link to this page from the dataset metadata. On Tue, Nov 22, 2022 at 18:48 Volkan ***@***.***>...