tiny-web-crawler icon indicating copy to clipboard operation
tiny-web-crawler copied to clipboard

Published 20 hours ago • verified publisher icon indrajithi

Crawl depth per domain

Open indrajithi opened this issue 1 year ago • 1 comments

  • Option to control how many links will be crawled from the same domain

indrajithi avatar Jun 17 '24 21:06 indrajithi

@indrajithi https://github.com/akumathedyn123/python-webpage-2-txt-web2txt try this

akumathedyn123 avatar Apr 27 '25 17:04 akumathedyn123