jprq icon indicating copy to clipboard operation
jprq copied to clipboard

Unwanted Search Engine Crawling of Subdomains

Open hoosnick opened this issue 2 years ago • 0 comments

I don't know if this is an issue with jprq, but I'm sure it can cause affliction, as it did for me.

When I create a tunnel, Yandex/Google's Crawler Robots try to index my site from the subdomain with a request to my main page and robot.txt, I don't want it.

image

The descriptions, links, payloads from meta tags of my 2-3 private projects are already on the open web(

image

hoosnick avatar Sep 09 '23 10:09 hoosnick