usa-dashboard icon indicating copy to clipboard operation
usa-dashboard copied to clipboard

Published 20 hours ago • verified publisher icon Data4Democracy

Scrape crime data

Open seanjtaylor opened this issue 8 years ago • 5 comments

We need the data to have the following fields:

  • city
  • crime category
  • date
  • count of unique incidents

We can work down the list of MSAs by population: https://en.wikipedia.org/wiki/List_of_Metropolitan_Statistical_Areas

New York: http://www.nyc.gov/html/nypd/html/analysis_and_planning/historical_nyc_crime_data.shtml

Los Angeles: No clear source.

Chicago: https://data.cityofchicago.org/Public-Safety/Crimes-2001-to-present/ijzp-q8t2/data

seanjtaylor avatar Jan 13 '17 00:01 seanjtaylor

Louisville, KY - https://data.louisvilleky.gov/dataset/crime-data

seanjtaylor avatar Jan 13 '17 01:01 seanjtaylor

Sources look like files/one-time downloads with a data cleaning exercise vs web scraping. Is that accurate?

bstarling avatar Jan 13 '17 13:01 bstarling

Here is the data available from Little Rock, AR: https://data.littlerock.org/Public-Safety/COMPSTAT-Year-To-Date-as-2016/53ac-n7q5/data https://data.littlerock.org/Public-Safety/COMPSTAT-2015/ysqk-d7nm

hazel-bohon avatar Jan 13 '17 13:01 hazel-bohon

Hartford, CT (MSA 47 in the list): https://data.hartford.gov/Public-Safety/Police-Incidents-01012005-to-Current/889t-nwfu In a previous dashboarding project I pulled this crime data and formatted its fields that match the above requirements! The code is available here: https://github.com/jasdumas/hartford-police

Totally up for helping out anyone else who needs it!

jasdumas avatar Jan 13 '17 15:01 jasdumas

Chicago has an API for their crime data! https://data.cityofchicago.org/Public-Safety/Crimes-2001-to-present/ijzp-q8t2/data

alexmansourati avatar Jan 13 '17 19:01 alexmansourati