Broken scrapers and stability

[razfag]

As it stands now a broken scraper can break the whole application, even make it crash or keep it from running.

The whole application seems to tightly coupled to the scraping subsystem and I question if it's the best approach to have scrapers as part of the main application.

In the mid term some proper error handling would suffice.

Long term I'd suggest adding a node interpreter to the project and have scraping run inside that as javascript. This would make community contributions easier (lets face it there's some magnitudes more people with javascript knowledge than go) and it would take the pressure off regarding the whack-a-mole game of website changes and keeping everything functioning.