Robots.txt-Parser-Class
Robots.txt-Parser-Class copied to clipboard
Relative paths is always allowed
User-agent: *
Disallow: /
$this->assertTrue($parser->isDisallowed("&&1@|"));
$this->assertFalse($parser->isAllowed('+£€@@1¤'));
The two tests above fails, paths allowed according to the parser, the robots.txt says otherwise...
At least the second one could also be an potential relative path, so we can't just ignore this bug either, we have to fix it...
Also applies to:
$this->assertFalse($parser->isAllowed('path'));
$this->assertFalse($parser->isAllowed('*wildcard'));
I'm not sure why I didn't test that earlier... :confused: This is no longer an low-priority issue, but an huge and prioritized one!