zimit icon indicating copy to clipboard operation
zimit copied to clipboard

Full scrape fails while limited one succeeds

Open Popolechien opened this issue 2 years ago • 2 comments

A user ran a successful (?) scrape of ivelt.com via youzim.it and asked if getting a fuller copy would be doable. I obliged and created https://farm.openzim.org/recipes/ivelt.com

Two successive runs have failed (I tried increasing available Memory and RAM between those two, but to no avail). Any idea what I could be missing there?

Popolechien avatar Apr 25 '23 14:04 Popolechien

I don't think this website satisfies our criteria for our library. If one is not satisfied with the youzim.it limits, one can run zimit locally via Docker.

Btw the Name metadata is not correct.

As for the error, the crawler crashed. Indeed it mentions RAM

rgaudin avatar Apr 25 '23 14:04 rgaudin

See https://github.com/webrecorder/browsertrix-crawler/issues/298

rgaudin avatar Apr 26 '23 09:04 rgaudin

Most probably already solved since months (not saying that the recipe succeeds, but memory issues are gone).

benoit74 avatar May 28 '24 13:05 benoit74