js-crawler icon indicating copy to clipboard operation
js-crawler copied to clipboard

Getting every type of url from the page source

Open shekarls opened this issue 8 years ago • 1 comments

Hello, Thanks for the nice robust crawler, Currently js-crawler crawls thru all visible links on the page, but I was wondering if it supports other href types like img/rel/src etc to be scrapped from the page.

Thanks shekar

shekarls avatar Jul 20 '16 17:07 shekarls

Thank you for using the crawler and for a feature suggestion. In the next version of crawler we may consider including options like crawlImg, crawlRelSrc which will enable crawler to crawl such links.

amoilanen avatar Jul 21 '16 17:07 amoilanen