Crawler throws error when URL has leading/trailing whitespace

[gardon]

Given that browsers ignore the whitespace and links work, the crawler should be able to trim it before the request.

[kdborg]

This should now be fixed.