Fix ignores when searching subdirectories

[sengaya]

When searching subdirectories the path was not correctly build and included duplicate parts. This fix will remove the duplicate part if possible. It also contains a small optimization that will skip the second for loop if there is already a match.

Fixes #1757