data-science
data-science copied to clipboard
hackforla
CoP: Data Science: Native Land Attribution
Prerequisite(s)
If you would like to work on this issue, please add a comment below and include the following information:
- Your name
- How many hours you can commit to working on this in the next week (minimum of 2)
- Commit to providing an update with a comment before the next community of practice meeting
For example:
- John Doe
- I can commit to working on this issue 3 hours in the following week.
- Yes, I will provide an update on my progress with a comment below.
Once you have done this, please add yourself to the “Assignees” section on the right and update the issue weekly to document your progress.
Project Name: Native Land Attribution
Volunteer Opportunity: Data Analyst to Figure out the total list of native lands that LA County occupies.
The eventual use will be a presentation and a video like this tribute
Who to communicate your interest to
- Slack channel link: #data-science
- Slack name of person to contact in the channel: Abe Khaleghi
Resources: LA County zip and city list Native Land lookup Geospatial Data Analysis: GeoPandas, QGIS/ArcGIS
@ryanmswan Here is the history of the communication in the Data Science channel
Bonnie Apr 28th at 10:27 AM @channel if there is anyone looking for a quick Data project, we could use some help on this today: https://github.com/hackforla/data-science/projects/2#card-60044906 30 replies
Jude Calvillo 4 months ago Hey @Bonnie. Good to meet you. I haven't contributed in quite some time but saw this and thought it'd be a fun quickie. I haven't personally touched APIs in a while (part of this is trying to get back in the code, overall), but are we sure that the Native-land.ca API is working? I keep getting 403 errors upon calling it. That's really the final step in what I just made.
Jude Calvillo 4 months ago https://github.com/judecalvillo/native-land-attribution
judecalvillo/native-land-attribution Quickie project for Hack for LA Last updated a minute ago https://github.com/judecalvillo/native-land-attribution|judecalvillo/native-land-attributionjudecalvillo/native-land-attribution | Apr 28th | Added by GitHub (Legacy)
Albert Ulysses 4 months ago @Jude Calvillo yes it works, I tested it with Postman on my local machine yesterday and re-ran it just now. I would double check your headers if you're calling it from a script. 403 forbidden can also be a typo issue, maybe you've typed it wrong and the end point isn't public. (edited) :+1: 1
Albert Ulysses 4 months ago What are you using to make the call? If you have a python script I can take a quick look at it. I didn't see anything on Github (edited)
Jude Calvillo 4 months ago @Albert Ulysses ok, I'll check again, but I used the path on the website, then tried multiple methods of adding the query, to no avail. I'm using R.
Albert Ulysses 4 months ago can you send the error message?
Albert Ulysses 4 months ago then also, send the endpoints - maybe I can test those
Jude Calvillo 4 months ago I just used what's on the site/documentation. Example: https://native-land.ca/api/index.php?maps=territories&position=42.553080,-86.473389
Albert Ulysses 4 months ago hmm can you send the error you're getting? I just copied that and it works.
Albert Ulysses 4 months ago
Jude Calvillo 4 months ago Yeah, when you go straight browser, it works. 403 error. I'm currently mobile, so can't get the full response right now but will send a little later this afternoon.
Albert Ulysses 4 months ago I'm not using a browser, I'm using postman. I also tested it using curl on my terminal. I think the issue is in your headers. Probably isn't giving some information and the native-land api is denying anything that looks too much like a bot.
Jude Calvillo 4 months ago Ok, I thought that might be a possibility, but what info would I need to add to header? -- Also, I REALLY gotta stop making my requests from the Ukraine. :-/
Albert Ulysses 4 months ago oh. lol can't tell if that's joke, but yeah making api calls from outside of the US is problematic. I have someone on our team in Australlia and he can't do some of his scraping for us because he has an internatioal ip (edited)
Jude Calvillo 4 months ago Oh, totally a joke. Sorry. :grin: I'll try experimenting with various header combos later today. Thanks again, @Albert Ulysses!
Albert Ulysses 4 months ago sure no problem, if you still have problems with it later, I can possibly make the calls for you. :+1: 1
Jude Calvillo 4 months ago @Albert Ulysses, got it to work! Looks like I needed to add a user-agent header. :confused: -- Thanks. I'll wrap up and post later today. Have a good one! :+1: 1
Albert Ulysses 4 months ago cool, glad to hear
Jude Calvillo 4 months ago Oh, can you or @Bonnie confirm: For the project in question, are you only looking for which lands are being occupied, or are you looking for their geometry as well?
Albert Ulysses 4 months ago I think there is a separate thread where she wrote what her expectations were. I'll @ you :+1: 1
Jude Calvillo 4 months ago Repo updated and ending w/resultant file for just lands and languages per zip. But I can create another dataset for geos, if necessary: https://github.com/judecalvillo/native-land-attribution
judecalvillo/native-land-attribution Quickie project for Hack for LA Last updated 6 minutes ago https://github.com/judecalvillo/native-land-attribution|judecalvillo/native-land-attributionjudecalvillo/native-land-attribution | Apr 28th | Added by GitHub (Legacy)
Albert Ulysses 4 months ago hey @Jude Calvillo did you submit the project ?
Jude Calvillo 4 months ago Oh, I don't know of the protocols, @Albert Ulysses, but if someone can point me in the right direction, I'd be happy to do what's required. I just saw the call for help and thought it'd be a great opportunity to reacquaint myself with hands on coding.
Albert Ulysses 4 months ago I think @Bonnie wanted it submitted to this: https://www.tribute.co/nac-land-acknowledgements/?name=National&email=nac%40codefora[…]utm_medium=email&utm_campaign=website&utm_source=sendgrid.com with a list for la county. Then potentially also move it to the hackforla website. I would double check the original thread!
TributeTribute Tribute for NAC Land Acknowledgements - Code for America Summit We're creating a video montage (or "Tribute") for NAC Land Acknowledgements and want you to join us. It will only take you a minute to record your video and you can do it from any device. Click on the link to learn more and submit your video. Thanks! (34 kB) https://www.tribute.co/nac-land-acknowledgements/?name=National&email=nac%40codeforamerica.org&utm_medium=email&utm_campaign=website&utm_source=sendgrid.com
Jude Calvillo 4 months ago Oh, shoot. I'm visiting family right now. I'll look for the original thread in the morning, if that's ok. :+1: 1
Bonnie 4 months ago @Jude Calvillo At the present moment I am just looking for the list of tribes for LA county so I can make a tribute video.
Jude Calvillo 4 months ago @Bonnie, LMK if this does the trick for you... https://raw.githubusercontent.com/judecalvillo/native-land-attribution/master/dat/los-angeles-county_native-american-lands.csv
Bonnie 4 months ago @Jude Calvillo yes, that’s awesome. Can I get a list of all the tribes without dupes? :+1: 1
Jude Calvillo 4 months ago @Bonnie sure. I can do that before bed. In the meantime, you might want to try opening this up in Excel, then simply selecting the "native _territories" column and going to Data > Text to Columns in the menu, then creating a field with a formula for UNIQUE(... and selecting the resultant cells from the previous step. That should give you the uniques after parsing them out. -- I'd totally do that for you, but I'm currently picking someone up from the airport. Hope you're having a nice weekend.
Jude Calvillo 4 months ago @Bonnie here ya' go: Chumash, Tongva, Kizh, Micqanaqa’n, Fernandeño Tataviam, Acjachemen (Juaneño), Payómkawichum (Luiseño), Yuhaviatam/Maarenga’yam (Serrano), Kitanemuk :heart: 1
Next steps are
- [x] reach out to the original data scientist who made this Jude Calvillo and ask him if he is interested in making a presentation out of his findings?
- [ ] If no, then put in the prioritized backlog for someone to make a presentation out of it, and dicuss with team at next meeting.
Additional work that should be done on this issue:
- [ ] Expand on existing work with additional data analysis on Native Land data.
- [ ] Create visualizations that help illustrate data
- [ ] Develop a presentation outlining findings and opportunities for additional research
@mcmorgan27 is available to help if you need. He wrote the geospatial tutorial.
Hi @KathrynPanger I wanted to check-in and see if you could update your progress on the Native Land Attribution issue here.
Don't worry, I'm still working in it. I got COVID. I'll be fine but recovery is slow.
On Thursday, 12 May 2022, Abe @.***> wrote:
Hi @KathrynPanger https://github.com/KathrynPanger I wanted to check-in and see if you could update your progress on the Native Land Attribution issue here.
— Reply to this email directly, view it on GitHub https://github.com/hackforla/data-science/issues/45#issuecomment-1125422641, or unsubscribe https://github.com/notifications/unsubscribe-auth/AO5M3HBP5GYB7E34MFFA7NDVJVXCBANCNFSM5AOYBFMA . You are receiving this because you were mentioned.Message ID: @.***>
@KathrynPanger
So the link for the json files - https://native-land.ca/resources/api-docs/
Jurisdiction boundary files - https://data.lacounty.gov/GIS-Data/City-Boundaries/wyja-ysz2
Build two data frames and use
Figure out how to use geopandas spatial join to see which polygons intersect (city of la and territories)
...
I do not yet have permission to push code here, so I forked the repo here.
My goal is to create a map with three layers: 1) territories taken from the native-land api, 2)LA city boundaries, and 3)a background map. I have created two code structures to achieve this. The first is a set of three python files designed to create a layered "projection" object from three "map" objects (files = main.py, projection.py, and map.py) and the second is a jupyter notebook containing my map-making experiments (file = map.ipynb). The first of these two structures should be able to create similar layered maps for anywhere in the country, when finished. The second (the notebook) will only create this specific layered map.
As of now, the notebook creates a layered map, but it is zoomed out too far. Something is causing the bounding box to be specified too large in spite of the fact that I selected what ought to be the correct maximum and minimum latitude and longitude values required to draw the box. The three python files do not yet work either; they are not returning a final layered map even though they seem to be creating each individual map layer correctly. I am currently working on debugging both, and I have some good leads as to what is going wrong.
Hi @KathrynPanger were you able to get the zooming problem resolved? Any other updates to this issue?
@KathrynPanger Please provide update
- Progress: "What is the current status of your project? What have you completed and what is left to do?"
- Blockers: "Difficulties or errors encountered."
- Availability: "How much time will you have this week to work on this issue?"
- ETA: "When do you expect this issue to be completed?"
- Pictures (if necessary): "Add any pictures that will help illustrate what you are working on."
Also, let us know if you need us to import the repo to hackforla and give you access to it.
@KathrynPanger I am going to return this to the backlog. Let me know if you'd like to resume work on this at any point.
@sayantaniadhikari01 I am going to return this issue to the backlog. Let me know if there is another project you'd like to work on.
- Sarah Dresser
- I am able to commit 4 hours in the next week
- Yes, I will provide updates on my progress in the comments
Hi @sdress I am going to move this issue to the backlog for another volunteer to pick up since there have been no updates on your progress.
- Jonathan Yun
- I am able to commit 4 hours to this project
- Yes, I will provide updates on my progress in the comments.
Link to the forked repository. Currently exploring the data. https://github.com/Jonathanyun/native-land-attribution
@akhaleghi currently debugging issues with code, will update the repo once I have fixed issues
@Jonathanyun Please provide update
- Progress: "What is the current status of your project? What have you completed and what is left to do?"
- Blockers: "Difficulties or errors encountered."
- Availability: "How much time will you have this week to work on this issue?"
- ETA: "When do you expect this issue to be completed?"
- Pictures or links* (if necessary): "Add any pictures or links that will help illustrate what you are working on."
- remember to add links to the top of the issue if they are going to be needed again.