zimit
zimit copied to clipboard
Why thecodelesscode.com is not retrieving /topics and /contents and /names links on homepage
Recipe: https://farm.openzim.org/recipes/thecodelesscode.com_en_all
Bug: the crawler does not find the /topics and /contents and /names links on homepage (and maybe others).
Tests done:
- passing a mobile device in landscape (Pixel 2 landscape)
- passing a bigger mobile device in landscape (Pixel 5 landscape)
- passing no mobile device
All without success, only 5 links to various cases are found on the homepage
Command used in first tests:
docker run -v $PWD/output:/output --name crawlme --rm webrecorder/browsertrix-crawler:1.2.4 crawl --failOnFailedSeed --behaviors "autoplay,autofetch,autoscroll" --url "http://thecodelesscode.com" --mobileDevice "Pixel 2" --cwd /output --combineWARC --depth 1