deegree3 icon indicating copy to clipboard operation
deegree3 copied to clipboard

Replace deegree-compliance-tests by official and final OGC ETS

Open tfr42 opened this issue 8 years ago • 6 comments

Currently the OGC CITE Tests in deegree-tests/deegree-compliance-tests for

  • WCS 1.0.0
  • WFS 1.0.0, 1.1.0
  • WMS 1.1.1, 1.3.0 are based on quite old forks of the related OGC ETS.

Prefered setup is based on most recent release version of the official OGC CITE ETS. Including ETS for:

  • WFS 2.0
  • WMTS 1.0
  • CSW 2.0.2
  • WPS 1.0

tfr42 avatar Sep 19 '16 18:09 tfr42

CLI available in OGC TEAM engine: https://github.com/opengeospatial/cite/wiki/Conformance-Testing-with-TestNG-Part-2#12-2-command-shell-console All-in-one (AIO) JAR available for WFS 2.0 ETS from https://repo1.maven.org/maven2/org/opengis/cite/ets-wfs20/1.32/

tfr42 avatar Dec 05 '19 15:12 tfr42

The OSGeo Foundation has started an OGC Certification Service to provide a public demonstration instance used for the OGC TEAM Engine to be executed against. See the wiki https://wiki.osgeo.org/wiki/OGC_Certification_Services for more information.

tfr42 avatar Jun 24 '20 08:06 tfr42

Disadvantage when decoupling the CITE integration tests from Maven build: Tests cannot be executed against feature branches used for pull requests.

Possible workflows (decoupled from Maven build):

  • Workflow 1: Usage of Docker (independent from OGC infrastructure).

      1. Create and start Docker Container with latest deegree artifact.
      • deegree CITE workspace is integrated into the container.
      1. Create and start Docker Container of OGC test suites.
      • These are available via Docker Hub (https://hub.docker.com/u/ogccite).
      1. Execute SoapUI tests which use the REST interface of the OGC test suites to test the deegree endpoints.
      • SoapUI parses the responses and applies assertions.
      • SoapUI tests can be started headless either via Maven or CLI.
      • Alternatively, Java can be used instead of SoapUI.
  • Workflow 2: No usage of Docker (depends on OGC infrastructure).

      1. Start the latest deegree artifact with Java (e.g. via using Maven plus plugin).
      • deegree CITE workspace can be accessed by deegree instance.
      1. Execute SoapUI tests which use the REST interface of the OGC infrastructure (https://cite.opengeospatial.org/teamengine/) to test the deegree endpoints.
      • See sub bullet points of step 3 of workflow 1.
  • Workflow 3: No usage of Docker (independent from OGC infrastructure).

      1. Start the latest deegree artifact with Java (e.g. via using Maven plus plugin).
      • deegree CITE workspace can be accessed by deegree instance.
      1. Use the CLIs of the OGC test suites to test the deegree endpoints.
      • Java is used for parsing and evaluation of the results.
      • There are two mechanisms: All-in-one (AIO) JARs (only new test suites) and TEAM Engine via command line (setup quite complex).

All workflows can be realized via Jenkinsfile(s).

dstenger avatar Jan 07 '21 18:01 dstenger

Currently the OGC CITE Tests in deegree-tests/deegree-compliance-tests for

  • WCS 1.0.0

OGC CITE status: Production Repo: https://github.com/opengeospatial/ets-wcs11/

  • WFS 1.0.0, 1.1.0

OGC CITE status: Production, Production Repo: https://github.com/opengeospatial/ets-wfs10, https://github.com/opengeospatial/ets-wfs11

  • WMS 1.1.1, 1.3.0

OGC CITE status: Production, Production Repo: https://github.com/opengeospatial/ets-wms11, https://github.com/opengeospatial/ets-wms13

are based on quite old forks of the related OGC ETS.

Prefered setup is based on most recent release version of the official OGC CITE ETS. Including ETS for:

  • WFS 2.0

OGC CITE status: Production Repo: https://github.com/opengeospatial/ets-wfs20

  • WMTS 1.0

OGC CITE status: Production Repo: https://github.com/opengeospatial/ets-wmts10

  • CSW 2.0.2

OGC CITE status: Production Repo: https://github.com/opengeospatial/ets-csw202

  • WPS 1.0

OGC CITE status: Beta (development is currently ongoing) Repo: https://github.com/opengeospatial/ets-wps10

dstenger avatar Mar 03 '21 15:03 dstenger

OGC TEAM Engine is available via docker hub, see #1276

tfr42 avatar Feb 06 '22 14:02 tfr42

Both OGC CITE test environments (https://cite.ogc.org/teamengine/ and https://cite.ogc.org/te2/) are now also available via Docker Hub:

  • https://hub.docker.com/r/ogccite/teamengine-production
  • https://hub.docker.com/r/ogccite/teamengine-beta

This makes it easy to setup the environment on a target machine to use it for automated integration tests (via REST interface).

dstenger avatar Feb 16 '22 16:02 dstenger