Noindex Code Search search results URLs

[fabicastp]

This is part of our work to improve our SEO.

Context: Code Search search results pages (e.g., /search?q=”Error+1001”) are indexable by search engines. These currently drive minimal traffic, <10 clicks per day.

It’s best practice to make your onsite search non-indexable, because it’s possible to send search engines to an infinite combination of new URLs, diluting the effectiveness of the important URLs.

TO DO: Add a meta robots “noindex, nofollow” to all search results page URLs (?q=), while ensuring that sourcegraph.com/search is still indexable.

[gitstart-app[bot]]

Here is the GitStart Ticket for this issue: https://clients.gitstart.com/sourcegraph/3436/tickets/SGM-6773

[gitstart-sourcegraph]

Hi @fabicastp We have opened the issue here as most of the work will be done on the frontend app