snowplow-rdb-loader icon indicating copy to clipboard operation
snowplow-rdb-loader copied to clipboard

Published 20 hours ago • verified publisher icon snowplow

Databricks loader: JDBC query timeouts not working

Open istreeter opened this issue 2 years ago • 0 comments

We were shown an example on Discourse where the Databricks Loader seemed to get stuck running SELECT 1 when it first started up. In the loader we use JDBC query timeouts so the query should never run for longer than 10 minutes. It is possible that this query timeout is not working properly with the Databricks driver.

If they query timeout does not work with this driver, then we should find some other way to make sure the loader shows liveliness.

istreeter avatar Oct 11 '22 20:10 istreeter