[DATA] dsfsi covid data NICD scraper broken

[vukosim]

@krokkie We are having a scraper issue again. Got this from Hugh Murrell

NICD web-scraper is broken.

A few days ago, The NICD changed the presentation format on its COVID dashboard and as a result faulty data is getting scraped for your South African provincial Covid count dataset on github.

Quite a few web apps make use of your dataset. Please can you ask someone to take a look at the problem

The break occurs between 22-11-2021 and 23-11-2021 in this dataset

https://raw.githubusercontent.com/dsfsi/covid19za/master/data/covid19za_provincial_cumulative_timeline_confirmed.csv

and that is when the NICD format changed.

[vukosim]

@krokkie can we close this now?

[krokkie]

This underlying data was broken, the scrapers worked fine. As pointed out by others, an improvement would be to add the published "new cases" numbers. I wanted to add this when I had a gap.

On Thu, Dec 2, 2021 at 3:17 PM Vukosi @.***> wrote:

@krokkie https://github.com/krokkie can we close this now?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/dsfsi/covid19za/issues/921#issuecomment-984618953, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADM6OFQTQA6IXZJZRSG2NXTUO5WVNANCNFSM5IYK6TKQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

-- Groete Gerhard Bijker