covid19japan-data icon indicating copy to clipboard operation
covid19japan-data copied to clipboard

we just hit the 5 million cells limit !!!

Open ggouaillardet opened this issue 4 years ago • 8 comments

We cannot add more cells otherwise it would be more than 5 million cells, and this is not supported.

I guess the easiest way to move forward is to create a new spreadsheet and have generate.js and friends merge both files.

Right now, we're stuck :-(

ggouaillardet avatar Dec 23 '20 10:12 ggouaillardet

tagging @reustle @liquidx to make sure you got that blocker issue.

ggouaillardet avatar Dec 23 '20 10:12 ggouaillardet

Thanks, it's odd because I was able to update it but it was super slow ...

liquidx avatar Dec 23 '20 10:12 liquidx

I'm deleting some columns and pruning some cells, but maybe tonight I might change the format of the Osaka or Tokyo tabs to compress the information

liquidx avatar Dec 23 '20 10:12 liquidx

I just quickly pushed a change that I wanted to do anyway, but this forces me to do it right now.

In every sheet, I changed the blank column that comes after "Status" into "Count". The generate script will now use that number to calculate how many patients that row represents. So instead of adding 300 rows for 300 patients, you can add one single row and add "300" to the count column.

If we start using this format, I think we should be able to reduce the number of rows we are using. It means we will lose some ability to annotate each patient with additional information, but I think this should at least make the sheet more scalable and might make data entry a bit easier.

If we need to expand the patients back up for some prefectures, it should be straightforward to do.

liquidx avatar Dec 23 '20 12:12 liquidx

Screen Shot 2020-12-23 at 21 18 46

Here is an example of how it looks in the Osaka tab, which is where I'm starting to use this format

liquidx avatar Dec 23 '20 12:12 liquidx

sounds great!

what about the Deceased patients? can we use the new 'Count' column? or do we still need one entry per patient?

ggouaillardet avatar Dec 23 '20 12:12 ggouaillardet

Right now I haven't tested it on deceased patients yet - I'm looking at testing that a bit before I think it's safe to use. Luckily deceased are less, so that's ok if right now it's still one per-row.

liquidx avatar Dec 23 '20 12:12 liquidx

I pushed a small fix to make it also work for deceased patients, so it looks like it's working now.

The spreadsheet also properly accounts for this format change.

liquidx avatar Dec 23 '20 13:12 liquidx