elasticsearch
elasticsearch copied to clipboard
ESQL: push down "[text_field] is not null"
Addresses https://github.com/elastic/elasticsearch/issues/102786.
I have noticed an improvement in response times for the following setup:
nyc_taxisindex with 1mil documents in it. 1 node. 5 shards, no replicas- one additional
messagefield of typetext. All 1 mil documents above do not have this field - indexed 10 more documents with a concrete value for
messagefield
Query with filter executes in 6-8ms: "query": "from nyc_taxis | stats count(message)", "filter": {"exists": {"field":"message"}}
Query with filter inside it used to execute in 10-12ms: "query": "from nyc_taxis | where message is not null | stats count(message)"
With this PR the second query executes in the same amount of time as the first one. Tests executed manually.
Hi @astefan, I've created a changelog YAML for you.
Pinging @elastic/es-analytical-engine (Team:Analytics)
@elasticmachine update branch