ismn icon indicating copy to clipboard operation
ismn copied to clipboard

Initializing ISMN_reader errors "INFO:root:no header:" on static_variables.csv files

Open vawalker opened this issue 3 years ago • 0 comments

ISMN_reader.get_climate_types() and ISMN_reader.get_landcover_types() result in empty dicts. For a subset of ~550 stations, ISMN_reader.get_dataset_ids() works as expected for variable='soil moisture' and variable='soil temperature' but returns an empty list for variable='air temperature'.

./python_metadata/metadata.log records an error for every static_variables.csv file in my subset indicating that the files do not have a header. Behavior exists when reading the subset files both as CEOP and as Header+values formatted. The module (v.0.3.2) passed the setup tests w/o error (two deprecation warnings). Python 3.7.6.

(ismn) []$ head -4 calval/ISMN/PanArctic_20150401-20181231/python_metadata/metadata.log 
INFO:root:no header: calval/ISMN/PanArctic_20150401-20181231/BIEBRZA_S-1/grassland-meteo-0/calval/ISMN/PanArctic_20150401-20181231/BIEBRZA_S-1/grassland-meteo-0/BIEBRZA-S-1_BIEBRZA-S-1_grassland-meteo-0_static_variables.csv
INFO:root:Error occured while reading metadata from csv file (calval/ISMN/PanArctic_20150401-20181231/BIEBRZA_S-1/grassland-meteo-0)
INFO:root:no header: calval/ISMN/PanArctic_20150401-20181231/BIEBRZA_S-1/grassland-soil-1/calval/ISMN/PanArctic_20150401-20181231/BIEBRZA_S-1/grassland-soil-1/BIEBRZA-S-1_BIEBRZA-S-1_grassland-soil-1_static_variables.csv
INFO:root:Error occured while reading metadata from csv file (calval/ISMN/PanArctic_20150401-20181231/BIEBRZA_S-1/grassland-soil-1)

The static_variables.csv files do appear to have a header.

(ismn) []$ head -3 calval/ISMN/PanArctic_20150401-20181231/BIEBRZA_S-1/grassland-soil-4/BIEBRZA-S-1_BIEBRZA-S-1_grassland-soil-4_static_variables.csv 
quantity_name;unit;depth_from[m];depth_to[m];value;description;quantity_source_name;quantity_source_description;quantity_source_provider;quantity_source_version;quantity_source_resolution;quantity_source_timerange;quantity_source_url;
bulk density;g/cm3;0.00;0.10;0.30;;insitu;in situ;;;;;;
saturation;m^3*m^-3;0.00;0.10;0.82;;insitu;in situ;;;;;;

vawalker avatar Jul 13 '20 14:07 vawalker