How to crawl current webpage only?

Open OpEnD17 opened this issue 1 year ago • 1 comments

Whenever I crawl a webpage, this tool not only scrapes the content of the webpage but also automatically visits the URLs on the page. This process is very time-consuming. How can I make the tool scrape only the content of the given webpage?

Nov 08 '24 08:11 OpEnD17

@OpEnD17 I'd like to see your code because our library doesn't work that way. When you pass a URL, it only crawls that URL and extracts links, but doesn't crawl the external links. Please share your code so I can help.

Nov 08 '24 12:11 unclecode

Closing this issue due to inactivity. Like mentioned by UncleCode this feature is still not available on our library.

Jan 21 '25 09:01 aravindkarnam