scivision icon indicating copy to clipboard operation
scivision copied to clipboard

Decide how to handle large datasets in Scivision

Open edwardchalstrey1 opened this issue 2 years ago • 2 comments

This was a point raised at the REG allocation meeting.

  • Could the Scivision frontend support running at scale (in the cloud when run through Binder, say?)
  • Might be a good fit for some of the Pangeo tooling
  • Something REG could help with

Perhaps to consider during a later phase of the project.

Can use intake for this

edwardchalstrey1 avatar Dec 01 '21 15:12 edwardchalstrey1

Related to #317

edwardchalstrey1 avatar Sep 23 '22 15:09 edwardchalstrey1

One answer: We don't handle "large" datasets that can't fit on Zenodo/GitHub

Perhaps encourage people to upload sample datasets

edwardchalstrey1 avatar Oct 12 '22 14:10 edwardchalstrey1