warn-scraper
warn-scraper copied to clipboard
Add MA scrape
Massachusetts only appears to provide a weekly report as an Excel (i.e. only containing any records for that week).
https://www.mass.gov/service-details/worker-adjustment-and-retraining-act-warn-weekly-report
Not worth scraping that Excel file. We should call MA media contacts to inquire how to get historical data and if there is a better alternative source online.
If no alternative online source is available, we could either:
- Write a scraper for the weekly file that merges new data with a historical dataset (if available)
- Just treat this as a state that requires a regular (monthly or quarterly?) records request for the data
Either way, we need to do some fact-finding before settling on a strategy.
Using Archive.org I did turn up reports for fiscal 2020 and 2021, but unclear to me whether these were the complete years at the time.
This looks really easy. I've requested earlier years, but FY2022 and FY2023 are here as a backup.
Weekly reports are cumulative for the latest year.