covid19za
covid19za copied to clipboard
[Feature] Mapping data for food security
We are looking for data to be able to evaluate South African food security [places to buy food during the lockdown] so would like to get a
csv or geojson
of available places to get food, what kind of establishment, district sizes and likely security indicators.
cc @nmoorosi
Maybe reach out to https://foodsecurity.ac.za/?
Thank you @anelda waiting for a response from them.
Hi, I've found this data source which includes all points of interest in SA - i believe it contains the information we are looking for.
https://data.humdata.org/dataset/hotosm_zaf_buildings
I'm busy mining this dataset to come up with filters for selecting building types where food would be able to be bought. Any ideas would be helpful.
I found that much of the data in that dataset was missing vital information. So I went and created this query for getting food / shops data from OpenStreetMap directly.
Please have a look and see if it's what was expected. Upon inspecting the data in my current location (which is quite remote), I found it contains all shops I know of.
Hi @Rendiere this is really a quick way to get a good start. Unfortunately for my town (Kleinmond) it only contains one shop while there are at least three or four more that sell food (even during lockdown). Also this will not include spaza shops. I wonder if there's a way to expand your query to include other search terms as well? Do you know if OSM have more than supermarket and convenience? Maybe greengrocer or such terms?
Hey @anelda , thanks for picking that up. Yeah, I'm looking into expanding the query right now. But to be honest, I doubt we will find any data source containing geospatial information on spaza shops...
I did a quick and dirty - please check if it passes the "Kleinmond Test" ;) (PS - my test is called the "Hermanus Test" -- we are basically neighbours)
But to be honest, I doubt we will find any data source containing geospatial information on spaza shops...
I hear you, but at the same time, there are studies like this (https://scholars.wlu.ca/cgi/viewcontent.cgi?article=1023&context=afsun), that means there is definitely information about spaza shops hidden in various places on the web... I guess it's about finding those and putting the information together for consumption...
Cool :-)
Unfortunately this query picks up Pep, Pet store, etc and misses OK Grocer, Friendly Grocer, Blou Bakkie (a green grocer), the BP and SASOL convenience stores and some others which names I don't know
Aaaah, looking at the data a bit closer I see that a high lever query of "shops" includes everything from pets to funerals. That's not what we want. I'll refine it to be more relevant.
Super!
Hmm, those you mentioned are still missing. I'm gonna look at the Google Places API, because a quick search showed those shops are listed on Google.
Google Places API specifically blocks scraping like this.
I suggest we use the OpenStreetMap data to build the rest of the pipeline / methods and work on improving the datasource as we go along?
We would also launch an effort to source this information as OSM is open-source...
I suggest we use the OpenStreetMap data to build the rest of the pipeline / methods and work on improving the datasource as we go along?
We would also launch an effort to source this information as OSM is open-source...
Feel free to fork my testing facilities map repo and replace the data.
I suggest we use the OpenStreetMap data to build the rest of the pipeline / methods and work on improving the datasource as we go along?
We would also launch an effort to source this information as OSM is open-source...
Hi @Rendiere, are you on the ZA Tech slack channel? See https://zatech.slack.com/archives/C7H003QF3/p1586720502130700
Hi @anelda , I am now. Is this where most of the discussion takes place?
Hi @anelda , I am now. Is this where most of the discussion takes place?
It's kind of a parallel community? Just trying to keep people aware of different groups working on the same thing, that's why I alerted you to this conversation and them to this thread :-)
Hey folks @anelda brought this to my attention. working on an open source food sec metadata project. Would love to find more projects like yours to contribute.
Hey @pappacorleone , welcome to this discussion - we need all the help we can get.
Do you mean to say you have been working on another food security metadata project which could help to contribute to this task?