unitedstates
Make development and deployment easier with Docker and/or Vagrant
How would this function in practice, with Docker? How would the scraper's output be obtained by client apps, for instance?
Ideally, shouldn't there be separation of concerns here? Where scraping/parsing is different from "publishing." The scraper could save to an S3 bucket, for example. The larger benefit might be that with Docker-ization, integration with whatever publishing system you want becomes much easier.
The scraper outputs to STDOUT precisely to separate concerns. I think Docker doesn't get in its way though, and re-transmits STDOUT from inside to out. I guess I'm asking you to confirm this, and/or make sure that if you do a PR with a Dockerfile, make sure the documentation includes how to get at the output.
Oh I see, even simpler :)
I still gotta test out the FISA stuff https://github.com/konklone/fisa/issues/10