covid19za icon indicating copy to clipboard operation
covid19za copied to clipboard

[DATA] Blip in the data

Open Diederikjh opened this issue 3 years ago • 6 comments

It looks like there is a bit of a blip in the test data.

See attached screenshot

Screenshot_20211124-063022

Diederikjh avatar Nov 24 '21 04:11 Diederikjh

Thanks @Diederikjh will check

vukosim avatar Nov 25 '21 11:11 vukosim

This is a pretty important fix that needs to be done. It seems Google is using the data from this repo- and with this new variant and all the news around it, when people search for "South Africa Covid" this graph with the blip shows up now. It looks very scary, as if this new variant has created a sudden crazy surge, and its likely having real repercussions.

lostpebble avatar Nov 26 '21 07:11 lostpebble

It appears as if there were some historic revisions to the data, artificially raising the number of positive cases by 18,000 from 23-Nov onwards. The number here: https://sacoronavirus.co.za/2021/11/23/update-on-covid-19-tuesday-23-november-2021/ reports 2.948m cumulative cases, where as the previous day it was 2.930m. See: https://sacoronavirus.co.za/2021/11/22/update-on-covid-19-monday-22-november-2021/
However, the "new cases" number does not reflect the 18k increase, it shows less than a 1000.... for the 23rd.

krokkie avatar Nov 26 '21 12:11 krokkie

Have been using this data for my website, what is the best way to handle revisions such as this for the graphical display of accurate daily new cases? Would it not be beneficial to add to the data set the officially reported daily new confirmed cases in addition to the cumulative total confirmed cases?

thomaslane avatar Dec 02 '21 11:12 thomaslane

@thomaslane Thanks so much for your concern. Its just that time of the year in teaching and exams so I have not had the time to give full attention to make a suggestion. Solid suggestions are welcome and we can involve some of the very active contributors such as @krokkie and @lrossouw

vukosim avatar Dec 02 '21 13:12 vukosim

Another idea: I've seen Time magazine's covid newsletter including backdated adjustments in the total infection number, but not the daily infection rate number. They did have an asterisk next to that row in the table for a few weeks,to explain the anomaly.

Diederikjh avatar Dec 02 '21 14:12 Diederikjh