Feature Request: Allow filtering of the record on output emit rather than before

[mlasevich]

Check CONTRIBUTING guideline first and here is the list to help us investigate the problem.

Is your feature request related to a problem? Please describe.

We are storing fields that we do not need.

Describe the solution you'd like

Would be nice to have a universal, simple way to filter out fields on output. Something built into the Output base rather than in every plugin.

Ideally it would be a simple remove_keys A,B,C parameter in output (or in buffer block)

Describe alternatives you've considered

An obvious alternative is to run a <filter> block before the output, but that causes problems because in many case I may need those fields in output to configure the outpuyt

Some examples:

• I want to output to an Elasticsearch to an arbitrary index - i have an index field, but I do not need it in my record in ES.
• I want to write to S3 bucket using a field as part of the hostname but not include that field in the record.

Additional context

N/A

[github-actions[bot]]

This issue has been automatically marked as stale because it has been open 90 days with no activity. Remove stale label or comment or this issue will be closed in 30 days