covidcg icon indicating copy to clipboard operation
covidcg copied to clipboard

Published 20 hours ago • verified publisher icon vector-engineering

Efficient sequence upload

Open atc3 opened this issue 3 years ago • 0 comments

Right now all sequences are uploaded every day - this will start to overrun our 24-hour update schedule

Proposal:

  • Upload sequence hash alongside sequence
  • Before upload, download complete list of Accession IDs + hashes
  • Locally compare hashes and only upload new Accession IDs and different hashes

atc3 avatar Jan 18 '22 23:01 atc3