scivision
scivision copied to clipboard
[ENH] Add various online datasources to the catalog (plugins)
Feature Request
Make various online data sources easily loadable via scivision
Describe the solution you'd like
Similar to #218 but for datasources instead of models
see: workshop notes
- [ ] Write a "how to build a scivision plugin" tutorial for a new online datasource
These would be a good to add:
- [ ] https://idr.openmicroscopy.org/cell/
- [ ] https://www.rxrx.ai/rxrx1#the-data
~~Also things like mnist - default image datasets~~ boring, let's stick to scientific imagery
- Miquel's csv-image intake driver would allow a few to be added easily (e.g. from squidle)
- Selected datasets from the Polar Data Centre (discussion with Paul B)
@quantumjot for the IDR data for example, what would you envision being in the scivision catalog? Do you think a catalog data entry that people can find via a query with a model trained on cell or tissue data, but which only has data for a specific example experiment would suffice? That way the user gets to discover the resource, and has some test data to play with, then they can go on to do things outside of scivision?
Idea from todays group session:
- Add catalogs other than the default that come from online e.g. https://stacspec.org/en/tutorials/access-sentinel-2-data-aws/ which can be opened with: https://github.com/opendatacube/odc-stac
- Would be great if there were similar examples from other domains
https://iiif.io/
another example: https://www.quantitative-plant.org/dataset
https://openorganelle.janelia.org/