bdq icon indicating copy to clipboard operation
bdq copied to clipboard

TG2-AMENDMENT_ESTABLISHMENTMEANS_STANDARDIZED

Open ArthurChapman opened this issue 1 year ago • 19 comments

TestField Value
GUID 15d15927-7a22-43f8-88d6-298f5eb45c4c
Label AMENDMENT_ESTABLISHMENTMEANS_STANDARDIZED
Description Proposes an amendment to the value of dwc:establishmentMeans using the bdq:sourceAuthority.
TestType Amendment
Darwin Core Class dwc:Occurrence
Information Elements ActedUpon dwc:establishmentMeans
Information Elements Consulted
Expected Response EXTERNAL_PREREQUISITES_NOT_MET if the bdq:sourceAuthority is not available; INTERNAL PREREQUISITES_NOT_MET if dwc:establishmentMeans is bdq:Empty; AMENDED the value of dwc:establishmentMeans if it can be unambiguously matched to a term in the bdq:sourceAuthority; otherwise NOT_AMENDED
Data Quality Dimension Conformance
Term-Actions ESTABLISHMENTMEANS_STANDARDIZED
Parameter(s) bdq:sourceAuthority
Source Authority bdq:sourceAuthority default = "Establishment Means Controlled Vocabulary List of Terms" {[https://dwc.tdwg.org/em/]} {GBIF vocabulary API [https://api.gbif.org/v1/vocabularies/EstablishmentMeans/concepts]}
Specification Last Updated 2024-02-08
Examples [dwc:establishmentMeans="vag.": Response.status=AMENDED, Response.result=dwc:establishmentMeans="vagrant", Response.comment="dwc:establishmentMeans contains an interpretable value in the bdq:sourceAuthority"]
[dwc:establishmentMeans="cultivated": Response.status=NOT_AMENDED, Response.result="", Response.comment="dwc:establishmentMeans is not an interpretable value in the bdq:sourceAuthority"]
Source TG2
References
  • Darwin Core Maintenance Group (2021) Establishment Means Controlled Vocabulary List of Terms. Biodiversity Information Standards (TDWG). http://rs.tdwg.org/dwc/doc/em/
  • Groom et al. (2019) Improving Darwin Core for research and management of alien species. Biodiversity Information Science and Services 3: e38084. https://doi.org/10.3897/biss.3.38084
Example Implementations (Mechanisms)
Link to Specification Source Code
Notes

ArthurChapman avatar Feb 07 '24 21:02 ArthurChapman

The Notes are in error. "Unknown" is not a valid value for the vocabulary. The corresponding standard controlled value "uncertain " and the preferred label "uncertain (unknown, cryptogenic)". See https://dwc.tdwg.org/em/.

tucotuco avatar Feb 07 '24 21:02 tucotuco

Like #268, maybe this should also be regarded as CORE now that there is a suitable Vocabulary. Again it received a rating of 6.5.

ArthurChapman avatar Feb 07 '24 21:02 ArthurChapman

Thanks @tucotuco - correct. I was misreading and going by memory. I've deleted the Note.

ArthurChapman avatar Feb 07 '24 21:02 ArthurChapman

@ArthurChapman I would concur, it makes good sense to include in core, some of the data quality needs elicited by TG3 do involve invasive species and the movement of species, so with vocabularies these tests do feel in scope for core.

chicoreus avatar Feb 08 '24 02:02 chicoreus

I've removed the Note as we seem to agree this is now CORE.

Tasilee avatar Feb 09 '24 00:02 Tasilee

The four tests (#277, #278, #268, #269) should be CORE (I have discussed this with Lee). Some reasons are

  • Invasive species are subject of the Convention on Biological Diversity Article 8(h) (https://www.cbd.int/idb/2009/about/cbd) and with a strong use case in the Cop 6 Decision last year VI/23 (https://www.cbd.int/decision/cop/default.shtml?id=7197)
  • These terms are recent additions to Darwin Core and are aspirational (we want all adding data follow the Standard)
  • There are good, well thought out vocabularies and APIs available
  • Apart from the CBD Use Case, there are good Use Case arguments given in Groom et al. (reference above)
  • There is no reason under our current criteria for excluding these tests from CORE

ArthurChapman avatar Feb 19 '24 23:02 ArthurChapman

We should be using the following value for the source authority:

bdq:sourceAuthority default = "Establishment Means Controlled Vocabulary List of Terms" {[https://dwc.tdwg.org/em/]} {GBIF vocabulary API [https://api.gbif.org/v1/vocabularies/EstablishmentMeans/]}

See: https://github.com/tdwg/bdq/issues/268#issuecomment-1961631041

chicoreus avatar Feb 23 '24 16:02 chicoreus

Thanks @chicoreus - Changing Source Authority from

[bdq:sourceAuthority default = "Darwin Core establishmentMeans" {[https://dwc.tdwg.org/list/#dwc_establishmentMeans]} {dwc:establishmentMeans vocabulary API [https://api.gbif.org/v1/vocabularies/EstablishmentMeans/concepts]}

to

bdq:sourceAuthority default = "Establishment Means Controlled Vocabulary List of Terms" {[https://dwc.tdwg.org/em/]} {GBIF vocabulary API [https://api.gbif.org/v1/vocabularies/EstablishmentMeans/]}

Tasilee avatar Feb 24 '24 03:02 Tasilee

I think https://api.gbif.org/v1/vocabularies/EstablishmentMeans/concepts is OK as a source authority because it actually has an API, as long as it is understood that the actually vocabulary is maintained at https://dwc.tdwg.org/em/ and the GBIF API is expected to remain up to date with that.

tucotuco avatar Mar 24 '24 01:03 tucotuco

https://api.gbif.org/v1/vocabularies/EstablishmentMeans/concepts added back in. Dunno why it was changed back.

Tasilee avatar Mar 25 '24 03:03 Tasilee

Changed Source Authority from

bdq:sourceAuthority default = "Establishment Means Controlled Vocabulary List of Terms" {[https://dwc.tdwg.org/em/]} {GBIF vocabulary API [https://api.gbif.org/v1/vocabularies/EstablishmentMeans/concepts]}

to

bdq:sourceAuthority default = "GBIF EstablishmentMeans Vocabulary" [https://api.gbif.org/v1/vocabularies/EstablishmentMeans]} {"dwc:establishmentMeans vocabulary API" [https://api.gbif.org/v1/vocabularies/EstablishmentMeans/concepts]}

Tasilee avatar Apr 16 '24 03:04 Tasilee

Source Authority should be

bdq:sourceAuthority default = "Establishment Means Controlled Vocabulary List of Terms" {[https://dwc.tdwg.org/em/]} {GBIF vocabulary API [https://api.gbif.org/v1/vocabularies/EstablishmentMeans/concepts]}

tucotuco avatar Apr 16 '24 17:04 tucotuco

Changed Source Authority from

bdq:sourceAuthority default = "GBIF EstablishmentMeans Vocabulary" [https://api.gbif.org/v1/vocabularies/EstablishmentMeans]} {"dwc:establishmentMeans vocabulary API" [https://api.gbif.org/v1/vocabularies/EstablishmentMeans/concepts]}

to

bdq:sourceAuthority default = "Establishment Means Controlled Vocabulary List of Terms" {[https://dwc.tdwg.org/em/]} {GBIF vocabulary API [https://api.gbif.org/v1/vocabularies/EstablishmentMeans/concepts]}

Tasilee avatar Apr 16 '24 21:04 Tasilee

The first example should be corrected to match the controlled vocabulary, and a disamiguation case that can be resolved from the controlled vocabulary, thus "Native" instead of "native" and "Native (Indigenous)" instead of "indigenous":

[dwc:establishmentMeans="Native (Indigenous)": Response.status=AMENDED, Response.result=dwc:establishmentMeans="Native", Response.comment="dwc:establishmentMeans contains an interpretable value according to the bdq:sourceAuthority"]

chicoreus avatar Apr 17 '24 16:04 chicoreus

Looking harder, this is actually a problem with the GBIF controlled vocabulary, it differs from the the TDWG vocabulary in case. The correct value is "native", not "Native". Implementors will have to be aware that the expected value needs to be an exact match to the TDWG vocabulary. This applies to several tests.

[dwc:establishmentMeans="Native (Indigenous)": Response.status=AMENDED, Response.result=dwc:establishmentMeans="native", Response.comment="dwc:establishmentMeans contains an interpretable value according to the bdq:sourceAuthority"]

chicoreus avatar Apr 17 '24 17:04 chicoreus

Since a ratified controlled vocabulary actually exists, we should urge GBIF to amend their implementation of the vocabulary.

tucotuco avatar Apr 17 '24 17:04 tucotuco

See https://github.com/tdwg/bdq/issues/275#issuecomment-2061845648

The GBIF API is only of partial help here, it does not provide the actual Controlled Values from the TDWG vocabulary, the values it has differ in case, implementations can use the GBIF API for its additional values, but need to align the case to match the actual Controlled Value from the TDWG vocabulary for the dwc: term values (GBIF API is sufficient for the dwciri term values).

chicoreus avatar Apr 17 '24 17:04 chicoreus

@tucotuco I agree.

chicoreus avatar Apr 17 '24 17:04 chicoreus

GBIF vocabulary has now been aligned with Darwin Core. Thanks @timrobertson100

Tasilee avatar May 14 '24 21:05 Tasilee