cookcountyjail2

cookcountyjail2 copied to clipboard

nwinklareth

All scraping endpoints error out. Please excuse me if I configured this wrong. I was wondering if this is still running for anyone.

rubinovitz

Trivial test to cement url generation from known/seeded data, including moving shared test data to its own space. Closes #70. The lower-casing of data is maybe a little cutesy :)...

alesage

add tests for url generation

3

eads

thinking there can be a configurable target % of urls and then some way of doing modulo math or taking a random sample of urls

eads

eads

You should consider retrying missing IDs from previous days

1

In the previous version, I had found that sometimes the Cook County website would not always generate a page for an inmate. So what I did was add logic to...

nwinklareth

eads

eads

Things to test: - [ ] Cleanup scripts - [ ] Spider use of config - [ ] Mirroring / saving bits - [ ] URL generation - [ ]...

eads