spyglass
spyglass copied to clipboard
Dandi export and read
Description
Partial steps for #861
-
Step (3)
- makes new table
DandiPath
- tracks translations between analysis file name and renamed path in a dandiset
- has method to stream data from dandi
- makes function
Export.compile_dandiset()
- Uses dandi api functions to get dandi-compliant names for files
- organizes and uploads files to dandi
- populates
DandiPath
- makes admin function
Export._prepare_files_for_export()
- Addresses common discrepancies between dandi standards and metadata in the nwb
- ensures all analysis files in the export set have unique uuid's #953
- resolves resulting mismatch between database checksum and altered file
- makes new table
-
Step (4)
- adds new fallback to
fetch_nwb
which streams file from dandi if available
- adds new fallback to
Checklist:
- [X] This PR should be accompanied by a release: unsure
- [ ] If release, I have updated the
CITATION.cff
- [X] This PR makes edits to table definitions: no
- [X] N/A If table edits, I have included an
alter
snippet for release notes. - [X] I have updated the
CHANGELOG.md
with PR number and description. - [X] I have added/edited docs/notebooks to reflect the changes
- [ ] Change the dandi url's from development to production server