Invalid Resource Map created by Metadata Editor

[vchendrix]

We had an issue this week where our user somehow created a corrupted resource map via the metadata editor. This resulted in them "losing" the data files they uploaded. The data files were listed in the EML but since the resource map could not be indexed the files were missing to the user.

Our solution was to create the missing resource map but we still don't understand how this could have happened.

from our user

Submitting an update to a dataset this morning. 

Spinning? Thought I had uploaded data files yesterday and hit ‘publish’. Data files?  

It’s… 

Jagadamma, S., Mayes, M.A., Steinweg, J.M., Wang, G., Post, W.M.2014.  
Organic Carbon Sorption and Decomposition in Selected Global Soils.

Our research It looks like one of the resource maps way back in the history was corrupted. When I tried to reindex the resource map, I got the following error. My thought is that flaky internet caused the resource map to be corrupted. The solution was to create the missing resource map

metacat-index 20200324-17:26:32: [ERROR]: SolrIndex.update - could not update the solr index for the object ess-dive-68e8f2dfeae30e5-20200323T184831616 since org.dspace.foresite.OREParserException: org.dspace.foresite.OREException: No Identifer statement was found for the resourceMap resource ('https://cn.dataone.org/cn/v2/resolve/ess-dive-68e8f2dfeae30e5-20200323T184831616') [edu.ucsb.nceas.metacat.index.SolrIndex:update:604]
org.apache.solr.client.solrj.SolrServerException: org.dspace.foresite.OREParserException: org.dspace.foresite.OREException: No Identifer statement was found for the resourceMap resource ('https://cn.dataone.org/cn/v2/resolve/ess-dive-68e8f2dfeae30e5-20200323T184831616')

Here is the output of the obsolescence chain before the data package was fixed.

$ essdive-search ess-dive-6af78a4b883e190-20200323T191037583

Search by ID: ess-dive-6af78a4b883e190-20200323T191037583
id=ess-dive-6af78a4b883e190-20200323T191037583 seriesId=
	formatType=METADATA
	title=Organic Carbon Sorption and Decomposition in Selected Global Soils
	obsoletes=ess-dive-d4712e7a7a63763-20200323T190449129
	obsoletedBy=
	resourceMap=
	documents=
	isDocumentedBy=
(essdive) vchendrix:essdive-admin val$ essdive-search ess-dive-6af78a4b883e190-20200323T191037583 --history

Search by ID: ess-dive-6af78a4b883e190-20200323T191037583
id=ess-dive-6af78a4b883e190-20200323T191037583 seriesId=
	formatType=METADATA
	title=Organic Carbon Sorption and Decomposition in Selected Global Soils
	obsoletes=ess-dive-d4712e7a7a63763-20200323T190449129
	obsoletedBy=
	resourceMap=
	documents=
	isDocumentedBy=
id=ess-dive-d4712e7a7a63763-20200323T190449129 seriesId=
	formatType=METADATA
	title=Organic Carbon Sorption and Decomposition in Selected Global Soils
	obsoletes=ess-dive-5f5781779039afe-20200323T185913178
	obsoletedBy=ess-dive-6af78a4b883e190-20200323T191037583
	resourceMap=
	documents=
	isDocumentedBy=
id=ess-dive-5f5781779039afe-20200323T185913178 seriesId=
	formatType=METADATA
	title=Organic Carbon Sorption and Decomposition in Selected Global Soils
	obsoletes=ess-dive-f2daee502d2a5d1-20200323T185130920
	obsoletedBy=ess-dive-d4712e7a7a63763-20200323T190449129
	resourceMap=
	documents=
	isDocumentedBy=
id=ess-dive-f2daee502d2a5d1-20200323T185130920 seriesId=
	formatType=METADATA
	title=Organic Carbon Sorption and Decomposition in Selected Global Soils
	obsoletes=ess-dive-ef57c1f78b47cc2-20200323T184704606
	obsoletedBy=ess-dive-5f5781779039afe-20200323T185913178
	resourceMap=
	documents=
	isDocumentedBy=
id=ess-dive-ef57c1f78b47cc2-20200323T184704606 seriesId=
	formatType=METADATA
	title=Organic Carbon Sorption and Decomposition in Selected Global Soils
	obsoletes=ess-dive-060419e3fbb4d54-20200318T165832926945
	obsoletedBy=ess-dive-f2daee502d2a5d1-20200323T185130920
	resourceMap=
	documents=
	isDocumentedBy=
id=ess-dive-060419e3fbb4d54-20200318T165832926945 seriesId=
	formatType=METADATA
	title=Organic Carbon Sorption and Decomposition in Selected Global Soils
	obsoletes=
	obsoletedBy=ess-dive-ef57c1f78b47cc2-20200323T184704606
	resourceMap=['ess-dive-49486481b035ad0-20200318T165834223709']
	documents=['ess-dive-060419e3fbb4d54-20200318T165832926945']
	isDocumentedBy=['ess-dive-060419e3fbb4d54-20200318T165832926945']

One of the faulty resource maps

<rdf:RDF
 xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
 xmlns:rd="http://www.w3.org/2000/01/rdf-schema#"
 xmlns:terms="http://purl.org/dc/terms/"
 xmlns:ter="http://www.openarchives.org/ore/terms/">
    <rdf:Description rdf:about="http://www.openarchives.org/ore/terms/Aggregation">
        <rd:isDefinedBy rdf:resource="http://www.openarchives.org/ore/terms/"/>
        <rd:label>Aggregation</rd:label>
    </rdf:Description>
    <rdf:Description rdf:about="https://cn.dataone.org/cn/v2/resolve/ess-dive-b8d1fda8baa6c8b-20200323T184706643">
        <terms:creator>DataONE.org Python ITK 3.4.7</terms:creator>
        <terms:identifier>ess-dive-b8d1fda8baa6c8b-20200323T184706643</terms:identifier>
        <rdf:type rdf:resource="http://www.openarchives.org/ore/terms/ResourceMap"/>
    </rdf:Description>
    <rdf:Description rdf:about="https://cn.dataone.org/cn/v2/resolve/ess-dive-b8d1fda8baa6c8b-20200323T184706643#aggregation">
        <ter:aggregates rdf:resource="https://cn.dataone.org/cn/v2/resolve/ess-dive-ef57c1f78b47cc2-20200323T184704606"/>
        <rdf:type rdf:resource="http://www.openarchives.org/ore/terms/Aggregation"/>
    </rdf:Description>
    <rdf:Description rdf:about="https://cn.dataone.org/cn/v2/resolve/ess-dive-ef57c1f78b47cc2-20200323T184704606">
        <terms:identifier>ess-dive-ef57c1f78b47cc2-20200323T184704606</terms:identifier>
        <ter:isAggregatedBy rdf:resource="https://cn.dataone.org/cn/v2/resolve/ess-dive-b8d1fda8baa6c8b-20200323T184706643#aggregation"/>
    </rdf:Description>
    <rdf:Description rdf:about="https://cn.dataone.org/cn/v2/resolve/ess-dive-68e8f2dfeae30e5-20200323T184831616">
        <ter:describes rdf:resource="https://cn.dataone.org/cn/v2/resolve/ess-dive-68e8f2dfeae30e5-20200323T184831616#aggregation"/>
    </rdf:Description>
    <rdf:Description rdf:about="https://cn.dataone.org/cn/v2/resolve/ess-dive-68e8f2dfeae30e5-20200323T184831616#aggregation">
        <ter:isDescribedBy rdf:resource="https://cn.dataone.org/cn/v2/resolve/ess-dive-68e8f2dfeae30e5-20200323T184831616"/>
    </rdf:Description>
</rdf:RDF>