warn-scraper icon indicating copy to clipboard operation
warn-scraper copied to clipboard

Fix AZ: Jobs totals sometimes disappear from day to day

Open palewire opened this issue 2 years ago • 1 comments

Our daily cron is warn-github-flow has discovered a quirk in Arizona's Job Center site.

The affected of employees is typically listed on notice detail page, as in this Nov. 2021 layoff at Zillow.

Screenshot from 2022-03-23 13-40-43

However, the logs from our daily scrapes suggest that those numbers can sometimes fail to appear, which triggers a null value to be scraped off the page. That then registers as a false amendment in our transformation workflow.

Screenshot from 2022-03-23 13-41-01

Just as they disappeared, the number seem to reappear later. Unless we can sort out the root cause of this bug, it has the potential to introduce some misleading churn to our daily updates.

palewire avatar Mar 23 '22 20:03 palewire

Screen Shot 2022-10-05 at 8 12 26 PM Not only does it seem to disappear, the number has changed as well. This is the same notice, but with 61 affected instead of 24. Perhaps them changing it has something to do with the null value?

Ash1R avatar Oct 06 '22 03:10 Ash1R