geopython
implement INSPIRE performance testing
cc @hannesaddec
Discussed during FOSS4G 2019, implement GHC test(s) that simulate testing a given service with a number of concurrent users to determine the average response time.
If someone can reference the requirement from INSPIRE that would be helpful.
https://inspire.ec.europa.eu/documents/technical-guidance-implementation-inspire-view-services-1 page 81 On Performance Performance shall be measured consistently based on sample reference requests to a given service. Minimum 10 reference requests per hour shall be issued to the service continuously during its lifetime. Structure of the sample reference request:
- The reference request shall request images of 800x600 pixels with a colour depth of 8 bits according to the image formats mandated by the regulation.
- The reference request shall request only 1 layer at a time. The structure of the sample reference request is recommended to:
- Be based on varying BBOX parameters. page 82 Evaluation and assessment criteria:
- The response of the service shall be valid according to the source data of the service and to the parameters in the capabilities for the requested area, i.e. min-max scale.
- A blank image is not valid if data is present for the given request parameters (BBOX, scale, etc.)
- The initial response time of 5 seconds refer to first byte returned by the service to the internet.
- A minimum of 90% of the initial services responses have to comply with the mandated 5 seconds response time, thus, a normal situation is identified by the 90% best performing sample reference requests. on Capacity: “The minimum number of served simultaneous service requests to a view service according to the performance quality of service shall be 20 per second.”
For CSW see page 43 in https://inspire.ec.europa.eu/documents/technical-guidance-implementation-inspire-discovery-services-0
For WFS see page 80 of https://inspire.ec.europa.eu/documents/technical-guidance-implementation-inspire-download-services
For WCS see page 52 of https://inspire.ec.europa.eu/id/document/tg/download-wcs
