spyglass icon indicating copy to clipboard operation
spyglass copied to clipboard

Dandi export and read

Open samuelbray32 opened this issue 9 months ago • 3 comments

Description

Partial steps for #861

  • Step (3)

    • makes new table DandiPath
      • tracks translations between analysis file name and renamed path in a dandiset
      • has method to stream data from dandi
    • makes function Export.compile_dandiset()
      • Uses dandi api functions to get dandi-compliant names for files
      • organizes and uploads files to dandi
      • populates DandiPath
    • makes admin function Export._prepare_files_for_export()
      • Addresses common discrepancies between dandi standards and metadata in the nwb
      • ensures all analysis files in the export set have unique uuid's #953
      • resolves resulting mismatch between database checksum and altered file
  • Step (4)

    • adds new fallback to fetch_nwb which streams file from dandi if available

Checklist:

  • [X] This PR should be accompanied by a release: unsure
  • [ ] If release, I have updated the CITATION.cff
  • [X] This PR makes edits to table definitions: no
  • [X] N/A If table edits, I have included an alter snippet for release notes.
  • [X] I have updated the CHANGELOG.md with PR number and description.
  • [X] I have added/edited docs/notebooks to reflect the changes
  • [ ] Change the dandi url's from development to production server

samuelbray32 avatar May 07 '24 19:05 samuelbray32