obnb icon indicating copy to clipboard operation
obnb copied to clipboard

Set up workflow to prepare archival data

Open RemyLau opened this issue 2 years ago • 0 comments

Use local workflow solutions, e.g., tox or CWL. For now, tox seems to be good enough.

Note: Can't use GitHub Action since some of the data requires more compute resources than that provided by GHA. Furthermore, uploading files to Zenodo is a bit inconsistent and may fail due to server load.

  • ~Iterate over all data objects, download and process accordingly~ (done)
  • ~Individually zip the data directories~ (done)
  • Upload the new version to Zenodo, and wait for manual publishing (do after https://github.com/RemyLau/py2zenodo/issues/3)
  • Upload to Dropbox as well for an alternative download option (do after https://github.com/RemyLau/py2zenodo/issues/4)

RemyLau avatar Aug 26 '22 21:08 RemyLau