elasticsearch
elasticsearch copied to clipboard
Capture additional info into failure documents
When a document fails in the ingest service and gets redirected to a failure store, we're adding some more information to aid debugging. This PR adds the pipeline
(the pipeline that failed to ingest the document), pipeline_trace
(the trace of pipelines that were executed on the document), processor_tag
, and processor_type
to the failure documents.
To accommodate for said changes, we're also updating the mappings of the failure store -- which we can do easily as failure stores are currently still behind a feature flag.
Pinging @elastic/es-data-management (Team:Data Management)
would it be possible to have an IT test?
I've updated 190_failure_store_redirection.yml to test for the newly added fields. Thanks for the suggestion.