ABrisset

Should it be possible to add "depth" in the data hash ?

3

Hello, As far as I can see, the generated hash for each page doesn't include the "depth" information, that is to say how many clicks from the homepage each page...

Trailing slash missing in URLs

1

When sitemap is build, each URL misses the trailing slash, _i.e_ `/`. That leads to 301 redirects to URL with trailing slash, which is not optimal for SEO. Could you...

I found that urls containing anchors like "#sku:123" (e.g a semi-colon) were not cleaned up when passed to the `to_absolute` method . As a consequence, they were escaped and added...

When anchor links are found during the crawl (i.e http://www.example.com/abc.html#foo), they are encoded : the anchor tag is replaced with the escaped character %23, which causes the page to respond...