docs-site
docs-site copied to clipboard
AV-69258 SEO disallow old SDK API docs
Update the robots to:
(rules checked in order)
- Allow certain entries defined in https://github.com/couchbase/docs-site/blob/master/etc/nginx/snippets/rewrites.conf under "Evergreen links for SDK API" These links DON'T include a version number, and always point to the most current version.
Includes /*-client/ and 4 hardcoded entries. This list would have to be manually updated if new SDKs/clients are added.
-
Disallow all other entries under /sdk-api/ (and specifically the versioned docs like /*-client-1.2.3/
-
Allow everything else (fallback rule)
NOTE: this solution should work only for SDK. Mobile doesn't (yet) have the concept of Evergreen link rewrites, but we could add this in a subsequent step.