osu-web
osu-web copied to clipboard
lazer.ppy.sh and dev.ppy.sh indexed by search engines
hard to consistently get these results but they do sometimes come up when i search something osu-related on DDG or google, usually pages on the wiki but through those domains. I think they should be excluded
lazer.ppy.sh is going away soon, but I guess we should add an envvar for noindex rules for dev, unless there's another way to have this applied?
google supports the X-Robots-Tag: noindex
http header, I'm not sure about others
Would be a good start.
(I mean as this part can be added via nginx for those domains, if it wasn't clear 👀 )
lazer.ppy.sh is gone, and header has been added to dev.ppy.sh :ok_hand: