cc-webgraph
cc-webgraph copied to clipboard
update wget/curl in scripts to retry on 503
Please see https://github.com/commoncrawl/cc-webgraph/issues/18 for an example problem and solution.
@sebastian-nagel you were out when I wrote the advice about wget/curl/awscli that's at https://status.commoncrawl.org/