spider
spider copied to clipboard
Parse URL twice when found anchor
I make a crawler who scan same URL. Here an example:
- https://www.jared.com/diamond-engagement-ring-78-carat-tw-roundcut-18k-white-gold/p/#
- https://www.jared.com/diamond-engagement-ring-78-carat-tw-roundcut-18k-white-gold/p/#skiptonavigation
- https://www.jared.com/diamond-engagement-ring-78-carat-tw-roundcut-18k-white-gold/p/#skip-to-content