craigs-yo
craigs-yo copied to clipboard
Sends a Yo for new listings on a craigslist search
Thanks for pointing this out Tejasmanohar, I need to get the html from the body of http://sfbay.craigslist.org/eby/apa/4890534256.html. Is there anyway to add a cachebuster to this? http://sfbay.craigslist.org/eby/apa/4890534256.html?_=123456 does not work....
Use a MongoDB cursor w/ long-polling to keep a _live_ user count on homepage (after #5)
Use cheerio and scrape data, don't save HTML as hash - unreliable comparisons
use logic provided [here](https://github.com/feedbin/support/issues/16#issuecomment-21021956), appending `&_=123456` to request URLs to get 200s on blocked servers like Heroku and AWS