covid-rt-estimates icon indicating copy to clipboard operation
covid-rt-estimates copied to clipboard

Improve log utility

Open seabbs opened this issue 3 years ago • 0 comments

Much of the current logging is informative but not truly helpful and makes understanding errors difficult (as logging doesn't stop on error). Having two layers of logging (summary + trace) would help this. Alternatives would be very welcome. This is of particularly important due to the lack of any other summary of progress either in the current set up or on batch (though perhaps the batch setup will contain some working summaries that I have missed)

Sample informative but not useful log segment:

2021-01-22 00:37:23 DEBUG add stats to output
2021-01-22 00:37:23 TRACE publish_data function
2021-01-22 00:01:40 TRACE run_regional_updates
2021-01-22 00:01:40 TRACE process includes
2021-01-22 00:01:40 TRACE filter datasets
2021-01-22 00:01:40 TRACE process locations
2021-01-22 00:01:40 INFO Processing dataset for united-kingdom
2021-01-22 00:01:40 TRACE loading ancillary data
2021-01-22 00:01:40 TRACE loading generation_time.rds
2021-01-22 00:01:40 TRACE loading incubation_period.rds
2021-01-22 00:01:40 TRACE loading onset_to_admission_delay.rds
2021-01-22 00:01:40 TRACE loading cases
2021-01-22 00:01:40 INFO Getting regional data

and

2021-01-22 00:38:27 TRACE generate metadata
2021-01-22 00:38:27 TRACE get_fields_list_fn
2021-01-22 00:38:27 TRACE get_keyword_list_fn
2021-01-22 00:38:27 TRACE get_author_list function
2021-01-22 00:38:27 TRACE get_dataset_contact_list function
2021-01-22 00:38:27 TRACE get_dataset_description_list function
2021-01-22 00:38:27 TRACE get_software_list function
2021-01-22 00:38:27 TRACE get_geographic_metadata_list

seabbs avatar Jan 22 '21 15:01 seabbs