elasticsearch icon indicating copy to clipboard operation
elasticsearch copied to clipboard

Track source for arrays of objects

Open kkrik-es opened this issue 9 months ago • 2 comments

This PR uses option store_array_source for objects to track the source of (sub)object arrays in synthetic mode. This allows preserving the original source, as synthetic mode merges, deduplicates and sorts array entries by default. The downside is that the whole object array (including children objects and fields) gets stored twice, while there's additional overhead while synthesizing source at query time.

This functionality will be experimental initially, to get some experience before documenting and opening up its use.

Fixes #90708

kkrik-es avatar May 08 '24 14:05 kkrik-es

Hi @kkrik-es, I've created a changelog YAML for you.

elasticsearchmachine avatar May 08 '24 14:05 elasticsearchmachine

Should we add documentation for new parameter?

I was thinking of keeping it experimental initially, until Observability provides feedback on its use. @felixbarny fyi.

kkrik-es avatar May 15 '24 08:05 kkrik-es

The store_array_source flag looks good to me, I've pinged the team to test it and provide feedback.

felixbarny avatar May 21 '24 14:05 felixbarny