bibxml-service icon indicating copy to clipboard operation
bibxml-service copied to clipboard

Source data validation issues

Open strogonoff opened this issue 2 years ago • 5 comments

Describe the issue

Stefano outlined discrepancies between data sources and relaton-py expectations here.

The discrepancies arise because (1) previously invalid YAML was updated to match Relaton RNC/LutaML data specification (where relaton-py has come to rely on YAML to be invalid), or (2) data specification updated, YAML updated accordingly, but relaton-py was not updated.

These discrepancies lead to issues like: #277, #250, #281.

Fronts on which they could be attacked:

  • [ ] Normalizing abnormal source data in BibXML service (fixes partly implemented in #282)
  • [ ] Making it so that abnormal source data doesn’t cause issues (not always realistic, but exploring options)
  • [ ] Pinning Relaton gems by their minor version part in GHAs (and relying on gem maintainers to avoid introducing breaking data format changes within the same minor version; I was informed that’s how it already works)
  • [ ] Updating Relaton specification to support versioning (medium term, we shouldn’t do it in rush)

Code of Conduct

strogonoff avatar Aug 31 '22 09:08 strogonoff