warn-scraper icon indicating copy to clipboard operation
warn-scraper copied to clipboard

Add MA scrape

Open Dilcia19 opened this issue 5 years ago • 2 comments

Massachusetts only appears to provide a weekly report as an Excel (i.e. only containing any records for that week).

https://www.mass.gov/service-details/worker-adjustment-and-retraining-act-warn-weekly-report

Not worth scraping that Excel file. We should call MA media contacts to inquire how to get historical data and if there is a better alternative source online.

If no alternative online source is available, we could either:

  1. Write a scraper for the weekly file that merges new data with a historical dataset (if available)
  2. Just treat this as a state that requires a regular (monthly or quarterly?) records request for the data

Either way, we need to do some fact-finding before settling on a strategy.

Dilcia19 avatar Oct 15 '20 21:10 Dilcia19

Using Archive.org I did turn up reports for fiscal 2020 and 2021, but unclear to me whether these were the complete years at the time.

chriszs avatar Jan 22 '22 06:01 chriszs

This looks really easy. I've requested earlier years, but FY2022 and FY2023 are here as a backup.

Weekly reports are cumulative for the latest year.

MassFY2023.xlsx MassFY2022.xlsx

stucka avatar Sep 29 '23 01:09 stucka