Auto-generated robots/humans files

[vikneke]

💡 Feature request

Is your feature request related to a problem?

It’s not necessarily a problem - more of a nice-to-have.

Example

It would be great to have an ability to use different version of robots.txt and humans.txt files depending on a node environment. This would therefore help prevent (although only to some extend) web crawlers from scanning dev sites but not prod sites.

Describe the solution you'd like

When starting one-app itself we could specify search engine preferences in a form of an argument. This is in addition to providing module map url.

one-app could provide a set of configurations for developers to choose from.

Describe alternatives you've considered

Alternatively developers could themselves provide static files to be served at the root level.

[JAdshead]

Thank you for raising the request. We will explore some ideas around this

[github-actions[bot]]

This issue is stale because it has been open 30 days with no activity. Remove no-issue-activity label or comment or this will be closed in 5 days.

[github-actions[bot]]

This issue is stale because it has been open 30 days with no activity.

[infoxicator]

The new Module as Text feature allows you to render plain/text on a specific route, https://github.com/americanexpress/one-app/pull/279 this feature could be used to render a different robots.txt file depending on the environment