drill icon indicating copy to clipboard operation
drill copied to clipboard

Query results caching

Open RayetSena opened this issue 1 year ago • 0 comments

Hello,

I am using http storage plugin and I want to activate the caching. In the documentation it says that this requires adding cacheResults. So I added this to my config. But when I run the same query again, there is almost no difference in query duration. You can see the configuration and query duration below.

image

{
  "type": "http",
  "cacheResults": true,
  "connections": {
    "opendata": {
      "url": "https://opendata.cbs.nl/ODataApi/odata/",
      "requireTail": true,
      "method": "GET",
      "authType": "none",
      "inputType": "json",
      "xmlDataLevel": 1,
      "postParameterLocation": "QUERY_STRING",
      "verifySSLCert": false
    }
  },
  "timeout": 4000,
  "retryDelay": 5000,
  "proxyType": "direct",
  "authMode": "USER_TRANSLATION",
  "enabled": true
}

image

Also I tried to configure the caching properties in the drill-override.conf file. Here is the configuration that I added:

drill.exec: {
    caching: {
	enabled: true
	storage:{
           type: “local”
           path:  “cache/directory”
        }
    }
}

Drill version 1.21.1

RayetSena avatar Feb 16 '24 14:02 RayetSena