cobweb icon indicating copy to clipboard operation
cobweb copied to clipboard

Redirect Limit causing crawl to stop

Open stewartmckee opened this issue 10 years ago • 0 comments

When the redirect limit is hit it kills the crawl. The RedirectError is thrown but doesn't seem to be trapped, it seems to be thrown for each subsequent call into the get method, which it shouldn't do because it should check that the redirect_limit has count down to 0.

stewartmckee avatar Jan 23 '15 08:01 stewartmckee