hakrawler icon indicating copy to clipboard operation
hakrawler copied to clipboard

Add `-i` flag (crawl inside path) and display an error on stderr if improper URLs are being given

Open garlic0x1 opened this issue 2 years ago • 1 comments

url.Parse does not return an error most of the time because it treats random strings as relative URLs.

garlic0x1 avatar Jun 22 '22 22:06 garlic0x1

Just pushed another update that adds the -i flag for limiting the crawl to inside a path.
for example echo https://example.com/outer_path/path1 | hakrawler -i will not crawl https://example.com/outer_path/

garlic0x1 avatar Jul 16 '22 22:07 garlic0x1

This is really great work, thanks garlic0x1 🙂

hakluke avatar Oct 14 '22 11:10 hakluke