js-crawler
js-crawler copied to clipboard
Getting every type of url from the page source
Hello, Thanks for the nice robust crawler, Currently js-crawler crawls thru all visible links on the page, but I was wondering if it supports other href types like img/rel/src etc to be scrapped from the page.
Thanks shekar
Thank you for using the crawler and for a feature suggestion. In the next version of crawler we may consider including options like crawlImg
, crawlRelSrc
which will enable crawler to crawl such links.