Bigquery Native Path for Azure Blob storage (WASB)

[utkarsharma2]

Please describe the feature you'd like to see Add native path support for Biquery and Native Path.

Ref: https://cloud.google.com/bigquery/docs/omni-azure-create-connection

[utkarsharma2]

There is a quota on daily data you can transfer from AZURE to Bigquey. We should highlight this link in our docs. ref: https://cloud.google.com/bigquery/quotas#query_jobs

[utkarsharma2]

There is a limitation that the table needs to be in the dataset which belongs to region azure-eastus2

[utkarsharma2]

Blocker: https://www.googlecloudcommunity.com/gc/Data-Analytics/Continuously-receiving-quot-internal-error-quot-issues-when/td-p/176607

Keep getting issue - An internal error occurred and the request could not be completed. This is usually caused by a transient issue. Retrying the job with back-off as described in the BigQuery SLA should solve the problem: https://cloud.google.com/bigquery/sla. If the error continues to occur please contact support at https://cloud.google.com/support. Error: 80324028

[utkarsharma2]

Started the thread at google group - https://www.googlecloudcommunity.com/gc/Data-Analytics/Bigquery-internal-Error/m-p/503707#M1107

[utkarsharma2]

Not working, same result as before with query:

LOAD DATA INTO `Utkarsh.testcsv`
FROM FILES (uris = ['azure://test.blob.core.windows.net/test-sdk/homes.csv'], format = 'CSV')
WITH CONNECTION `azure-eastus2.Astro-sdk-Azure`

Output:

An internal error occurred and the request could not be completed. This is usually caused by a transient issue. Retrying the job with back-off as described in the BigQuery SLA should solve the problem: https://cloud.google.com/bigquery/sla. If the error continues to occur please contact support at https://cloud.google.com/support. Error: 80324028

ref: https://www.googlecloudcommunity.com/gc/Data-Analytics/Internal-Error-for-BigQuery-Data-transfer/m-p/446088

[utkarsharma2]

issue created on BigQuery: https://issuetracker.google.com/issues/263976186

[phanikumv]

Waiting on a solution to the ticket created above

[sunank200]

A private ticket is created as per discussion on thread Have you received any email on this @utkarsharma2 @phanikumv ?