Taffy
Taffy copied to clipboard
Support for "X-Robots-Tag" header
I noticed that WordPress's API added support for the X-Robots_tag header about 5 years ago and wonder if it's something that should be added as a default Taffy API response header.
- https://core.trac.wordpress.org/ticket/36390
- https://support.google.com/webmasters/thread/18632399/how-to-stop-google-to-access-internal-api-urls-which-are-part-of-inline-js?hl=en
While this header can already be manually added as a custom header in the Application.cfc, I'm not aware of any reasons why this wouldn't be beneficial to add as a default.
globalHeaders = {
"X-Robots-Tag" = "noindex, nofollow, noimageindex"
}
Thoughts?
I agree that it seems harmless enough, but I wouldn't want to add it without some way to remove it if someone decides they don't want it.