space-buzzer

Results 5 issues of space-buzzer

[MD] fetch serology values from state dataset

Dataset: https://services.arcgis.com/njFNhDsUCentVYJW/ArcGIS/rest/services/MDCOVID19_SerologyTests/FeatureServer/0 Very ugly dataset :( How to map fields: NumberPeopleTestedType: Num_People_Tested --> Total Antibody Tests (People) NumberPeopleTestedType: Num_People_Positive_Test --> Positive Antibody Tests (People) NumberPeopleTestedType: Num_People_Negative_Test --> Negative Antibody Tests...

Data Source

Add reporting of metadata: number of fetched fields per state, total number of fields filled

[format] Store values per state files, add aggregation with most recent rows

Timestamping: find the timezone for each source and last-updated-at

- How to parse timestamps: update time of the table? the timestamp stored in the cell? - How to find the correct timezone? always use state official timezone?

enhancement
Data Source

Run requsets in parallel

Consider moving to Hydra, add multi-run and maybe a nicer CLI

enhancement