browsertrix-crawler icon indicating copy to clipboard operation
browsertrix-crawler copied to clipboard

Published 20 hours ago • verified publisher icon webrecorder

Video on kiwix.org homepage is not retrieved

Open benoit74 opened this issue 1 year ago • 1 comments

Basically, when running the crawler with official 0.12.2 Docker image on https://kiwix.org/fr/, the Youtube video on the home page is not in the WARCs:

docker run --rm -it -v ${PWD}/output:/output webrecorder/browsertrix-crawler:0.12.2  crawl --depth 0 --url https://kiwix.org/fr/ --cwd /output/.tmph919m5n3

For more details, see https://github.com/openzim/zimit/issues/247

benoit74 avatar Nov 15 '23 15:11 benoit74