webborer
webborer copied to clipboard
Automatically detect sites that respond with 200 to all URLs.
Some sites respond (incorrectly) to all URLs with a 200 response. We should detect and warn/abort on these. (Perhaps they can still be spidered via some string in the page?)
Or paths within it, such as PATH_INFO support.