city-scrapers

city-scrapers copied to clipboard

Process for approving a scraper request

2

I don't want this to get bogged down or overly formal, but it's worth considering having a rubric of sorts for evaluating the relative benefit of writing and maintaining a...

easherma

It would be useful to have some explicit https `start_urls` and `domain` test cases so that future changes to the template or tasks don't inadvertently assume http.

joshuarrrr

## What's this PR do? Adds more detail to our readme, rewords sections and reformats. In particular, it adds notes about how to run individual spiders and test them. ##...

SimmonsRitchie

I am new to python you are such a great programmer and great project. I was just curious how in this file https://github.com/City-Bureau/city-scrapers/blob/main/tests/test_chi_board_elections.py from city_scrapers_core.constants import COMMISSION, PASSED from city_scrapers_core.utils...

bubbsJanko

Bump certifi from 2023.5.7 to 2023.7.22

1

Bumps [certifi](https://github.com/certifi/python-certifi) from 2023.5.7 to 2023.7.22. Commits 8fb96ed 2023.07.22 afe7722 Bump actions/setup-python from 4.6.1 to 4.7.0 (#230) 2038739 Bump dessant/lock-threads from 3.0.0 to 4.0.1 (#229) 44df761 Hash pin Actions and...

dependabot[bot]

This issue was raised over a year ago and still hasn't been addressed. Is this project still active?

jtranquilli

https://www.chicago.gov/city/en/depts/cdot/supp_info/chicago-mobility-collaborative.html

rhetr

the `city-scrapers-core` package in the Pipfile is currently not referencing the latest git revision, which causes problems with `scrapy validate`. I'm updating the reference to be the same as the...

rhetr

Error with Chicago Community Land Trust Spider

1

I attempted to crawl with the chi_land_trust spider, but the page it scrapes now gives a 404 error page. The old URL was: https://www.chicago.gov/city/en/depts/doh/supp_info/chicago_communitylandtrust0.html I think the URl that should...

Hi-jinks