crawlee-python icon indicating copy to clipboard operation
crawlee-python copied to clipboard

Published 20 hours ago • verified publisher icon apify

Implement max crawl depth

Open vdusek opened this issue 6 months ago • 2 comments

  • Implement "max crawl depth" / "crawling depth limit"
  • See https://github.com/apify/crawlee-python/discussions/441
  • The depth information should be stored in the Request (user_data -> crawlee_data)

vdusek avatar Aug 26 '24 07:08 vdusek