zed icon indicating copy to clipboard operation
zed copied to clipboard

Provide metadata to intake shaper

Open alfred-landrum opened this issue 5 years ago • 1 comments

When a shaper is executed on received data, we can supply potentially useful metadata to the shaper code by making it available as a pre-defined value with a well known name. The metadata could include information about the intake, like its id & its target space. It could also provide any out-of-band information from the received data or transport; for example, in the case of the elasticsearch bulk api, this could be a means to provide the index name used in the bulk api request.

alfred-landrum avatar Feb 26 '21 17:02 alfred-landrum

#2242 is an implementation of a Z function parse_zson() that could be used for providing the metadata to shapers.

alfred-landrum avatar Feb 26 '21 21:02 alfred-landrum