airbyte icon indicating copy to clipboard operation
airbyte copied to clipboard

Snowflake Destination should check if it can create/write to staging location for internal staging

Open grishick opened this issue 2 years ago • 0 comments

Sometimes staging locations can have name collisions, which manifest in the following error:

SnowflakeInternalStagingSqlOperations.java
Function: uploadRecordsToStage
Type: java.lang.RuntimeException

Exceptions thrown while uploading records into stage: net.snowflake.client.jdbc.SnowflakeSQLException: SQL compilation error:
Stage 'AIRBYTE_DATABASE.PUBLIC.CUSTOMERNAME_EVENTS' does not exist or not authorized.
net.snowflake.client.jdbc.SnowflakeSQLException: SQL compilation error:
Stage 'AIRBYTE_DATABASE.PUBLIC.CUSTOMERNAME_EVENTS' does not exist or not authorized.
net.snowflake.client.jdbc.SnowflakeSQLException: SQL compilation error:
Stage 'AIRBYTE_DATABASE.PUBLIC.CUSTOMERNAME_EVENTS' does not exist or not authorized.

this should be reported as a config error and once we are able to run CHECK with connection config, this should be caught by CHECK

grishick avatar Feb 01 '23 16:02 grishick