zimit icon indicating copy to clipboard operation
zimit copied to clipboard

Why thecodelesscode.com is not retrieving /topics and /contents and /names links on homepage

Open benoit74 opened this issue 7 months ago • 0 comments

Recipe: https://farm.openzim.org/recipes/thecodelesscode.com_en_all

Bug: the crawler does not find the /topics and /contents and /names links on homepage (and maybe others).

Tests done:

  • passing a mobile device in landscape (Pixel 2 landscape)
  • passing a bigger mobile device in landscape (Pixel 5 landscape)
  • passing no mobile device

All without success, only 5 links to various cases are found on the homepage

Command used in first tests:

docker run -v $PWD/output:/output --name crawlme --rm  webrecorder/browsertrix-crawler:1.2.4 crawl --failOnFailedSeed --behaviors "autoplay,autofetch,autoscroll" --url "http://thecodelesscode.com" --mobileDevice "Pixel 2" --cwd /output --combineWARC --depth 1

benoit74 avatar Jul 23 '24 05:07 benoit74