Robots.txt-Parser-Class icon indicating copy to clipboard operation
Robots.txt-Parser-Class copied to clipboard

Relative paths is always allowed

Open JanPetterMG opened this issue 8 years ago • 1 comments

User-agent: *
Disallow: /
$this->assertTrue($parser->isDisallowed("&&1@|"));
$this->assertFalse($parser->isAllowed('+£€@@1¤'));

The two tests above fails, paths allowed according to the parser, the robots.txt says otherwise...

At least the second one could also be an potential relative path, so we can't just ignore this bug either, we have to fix it...

JanPetterMG avatar Jul 26 '16 19:07 JanPetterMG

Also applies to:

$this->assertFalse($parser->isAllowed('path'));
$this->assertFalse($parser->isAllowed('*wildcard'));

I'm not sure why I didn't test that earlier... :confused: This is no longer an low-priority issue, but an huge and prioritized one!

JanPetterMG avatar Jul 27 '16 19:07 JanPetterMG