Remove redundant noindex meta tag?

[hilja]

https://github.com/epicweb-dev/epic-stack/blob/9db9a75949463de571f3018d3b1151004d6c50e3/app/root.tsx#L172

Correct me if I’m wrong but since the 'X-Robots-Tag', 'noindex, nofollow' header is set in server:

https://github.com/epicweb-dev/epic-stack/blob/9db9a75949463de571f3018d3b1151004d6c50e3/server/index.ts#L217

The above meta tag might not be needed.

Instead of a tag, you can return an X-Robots-Tag HTTP header with a value of either noindex or none in your response.

At least that’s how I’m reading the Google docs.

[kentcdodds]

I do remember adding both of these, but I can't remember why I thought they were both necessary at the time. Maybe other search engines need them both? Or some use one and some use the other?

[hilja]

Interesting, you might be right. At least this blog post from ahrefs says some niche crawlers like Seznam only support the meta tag.