Henare Degan
Henare Degan
I just ran the PlanningAlerts scraper and the run finished OK but there was an error with the scraper: ``` Injecting configuration and compiling... [1G [1G-----> Ruby app detected [1G----->...
> Cannot allocate memory @ io_write There's plenty of disk and ram on the server so I don't know what this is about.
Here's an idea - could these scrapers be exhausting their container's RAM and that's what's causing the weird error message? We might be getting odd error messages because of the...
Ah ha! I just deliberately created a scraper that would exhaust memory and, what do you know, the output oddly stops and the run fails with status code 255: https://morph.io/morph-test-scrapers/morph-hansard...
> I need morph to come alive again to do that morph is... not alive?! Oh brother. It looks like the CPUs have been pegged for the last 12+ hours:...
> I guess it will take ages to clear the scraper queue though I just ran the test scraper and it's working.
Hi @walinchus :wave: please ask questions related to scrapers in the forum :point_right: https://help.morph.io/
Excuse my ignorance :) What's the reason for this?
Cool, thanks, that makes sense.
Warn user if they generate a database with the naming convention of the original scraperwiki library
I was just tripped up by this :unamused: