metacatui icon indicating copy to clipboard operation
metacatui copied to clipboard

Files missing from resource Map on replace

Open rushirajnenuji opened this issue 1 year ago • 1 comments
trafficstars

Describe the bug Report from @justinkadi:

I've been working on a data package that has run into many errors from the PI and from the datateam when making updates to it (ticket, dataset). The PI has run into a missing resource map and missing data files when she tries making updates to files with the web editor. She emailed me 5 CSV files and asked me if I could try replacing them for her since she's run into errors when she's tried. I downloaded her 5 CSV files and replaced them in the web editor. When I tried to save the changes, I got this series of errors. And when I went back to the data package, it was updated, but now a lot of the data files are missing and some only have their PID listed instead of their file name (here's the current dataset). Here's a progression of screenshots of what I saw when I clicked submit after replacing the files.

This had happened to me once already this morning, and I ended up with a data package with no resource map. I added the files back with update_resource_map() and tried it one more time to see if I could recreate the error. The same errors occurred, but instead of ending up with a data package with no resource map, I ended up with this data package that had only a couple files missing.

Screenshots

Screen Shot 2024-09-20 at 10 50 25 AM (2) Screen Shot 2024-09-20 at 10 50 18 AM (2) Screen Shot 2024-09-20 at 10 50 05 AM (3) Screen Shot 2024-09-20 at 10 49 55 AM (2) IMG_5022

Additional context From initial investigation:

debugging_log

This seems to be an issue with MetacatUI. It looks like, the csv files that Justin posted above were all updated and replaced by MetacatUI, but the changes were not propagated to either EML or ResMaps. So, on re-try to update the resourceMap with replacing the files - where the resourceMap is still pointing at obsoleted files, MetacatUI gave the error Justin posted in the second screenshot.

rushirajnenuji avatar Sep 30 '24 18:09 rushirajnenuji

Brief summary of issue from convo w/ Rushi about this today:

  • files objects get updated confirmed from sysmeta
  • try to save the package, eml/resoucemap fail for some reason - not sure of these conditions that caused that yet
  • they can't edit because metacatui is still pointing to the obsoleted version of the files

robyngit avatar Sep 30 '24 20:09 robyngit

Fixed with https://github.com/NCEAS/metacatui/pull/2736

robyngit avatar Sep 08 '25 14:09 robyngit