steampipe-plugin-sdk icon indicating copy to clipboard operation
steampipe-plugin-sdk copied to clipboard

Initial query execution time is longer than usual

Open misraved opened this issue 3 years ago • 5 comments

Steps to reproduce the error:

  • Build the latest AWS plugin from sdk_v4
  • Restart the Steampipe CLI (v0.16.0-rc.11)
  • Run a simple query like select * from aws_account

Observation Each time I execute the above-mentioned query in a new Steampipe CLI terminal session, the time taken for execution is relatively high. Following are the query execution times of each run -

Time: 34.7s. Rows fetched: 1. Hydrate calls: 2.
Time: 64.6s. Rows fetched: 1. Hydrate calls: 2.
Time: 23.4s. Rows fetched: 1. Hydrate calls: 2.

The expectation is that the query execution time will be faster. Please note similar issue did not exist in the v3.3.2 version of Steampipe plugin SDK.

misraved avatar Aug 19 '22 15:08 misraved

@misraved Can you please also post the times taken across 3 runs with the same CLI version and SDK v3.3.2?

cbruno10 avatar Aug 19 '22 16:08 cbruno10

As a random data point, on a Mac M1, with CLI versions v0.17.0-alpha.6 and v0.16.0-alpha.11, I ran against the aws_ec2_instance, aws_account, github_repository, and github_team tables, with queries like select * from aws_ec2_instance, and all of them finished in 1 minute or less.

cbruno10 avatar Aug 19 '22 18:08 cbruno10

@kaidaguerre @cbruno10 Query timings for Steampipe plugin SDK v3.3.2 are listed as follows:

Time: 3.5s. Rows fetched: 1. Hydrate calls: 2.
Time: 3.3s. Rows fetched: 1. Hydrate calls: 2.
Time: 4.0s. Rows fetched: 1. Hydrate calls: 2.

The above results are for the query - select * from aws_account

misraved avatar Aug 22 '22 05:08 misraved

@misraved Can you check if this is resolved in SDK v5? Feel free to close it if it works.

pskrbasu avatar Jun 27 '23 14:06 pskrbasu