scrapers
scrapers copied to clipboard
Centralize the fields.txt
Let's look at the scrapers we have and the fields they scrape, to see what we can learn from them.
Each scraper has a fields.txt.
Altering this should accomplish this goal. https://github.com/Police-Data-Accessibility-Project/PDAP-Scrapers/blob/main/common/utils/demo_utils/field_extractor.py