searvey icon indicating copy to clipboard operation
searvey copied to clipboard

retrieve IOC sensor types as metadata

Open carolakaiser opened this issue 3 years ago • 5 comments

Hi All,

Would it be possible to retrieve the sensor types for the IOC stations as an metadata attribute (with a list of sensors) for each station?

carolakaiser avatar Oct 12 '22 17:10 carolakaiser

Hi Carola

For the IOC station metadata we are parsing 3 HTML tables from the IOC website. These tables don't have such details. In order to retrieve this information we need to make an additional request per station, which means ~1000 requests for the full station-set.

The IOC guys asked us not to make more than 5 requests per second, so this would require something like 4 minutes. This type of response time is not something that we would like to have by default. That being said, I guess we could add a flag for this.

@bart-v Do you know if there is perhaps some better way to retrieve this info?

pmav99 avatar Oct 12 '22 20:10 pmav99

1 single request http://www.ioc-sealevelmonitoring.org/service.php?query=stationlist

bart-v avatar Oct 12 '22 22:10 bart-v

This is great @bart-v, thank you.

BTW, are there any other queries that are supported by the API? Are there any docs?

pmav99 avatar Oct 13 '22 07:10 pmav99

Yes. http://www.ioc-sealevelmonitoring.org/service.php?query=help See bottom, heading "Data access help"

bart-v avatar Oct 13 '22 07:10 bart-v

FIY, I tested the API to see if we could extract longer timeseries.

Here is a test with a startdate on the 1st of Jan 2022: https://www.ioc-sealevelmonitoring.org/service.php?query=data&format=json&code=audi&timestart=2022-01-01T00:00

Here is a test with a startdate on the 1st of Jan 2022 and forcing the the extraction for one year: https://www.ioc-sealevelmonitoring.org/service.php?query=data&format=json&code=audi&timestart=2022-01-01T00:00&timestop=2023-01-01T00:00

The result is still 30 days

tomsail avatar Jul 21 '23 16:07 tomsail