magento-full-page-cache-crawler icon indicating copy to clipboard operation
magento-full-page-cache-crawler copied to clipboard

Published 20 hours ago • verified publisher icon maverick193

Exclude from crawling

Open paul-hph opened this issue 9 years ago • 2 comments

is i possible to exclude pages from Crawling?

for example:

image

image

paul-hph avatar Jan 15 '16 18:01 paul-hph

Hi Paul, Sorry for this late answer, had no time to look into my github modules. This is good idea, since those dynamic urls should not be crawled, I'll put a "blacklist" where administrators can put their Urls which does not have to be crawled.

maverick193 avatar Dec 08 '16 07:12 maverick193

👍

paul-hph avatar Feb 10 '17 14:02 paul-hph