soda-core icon indicating copy to clipboard operation
soda-core copied to clipboard

Soda 914 extend bq authentication

Open linderttobias opened this issue 2 years ago • 2 comments

With GCP/BigQuery one has the option to use different methods to authenticate. The standard authentication methods are:

  1. Use of Application Default Credentials
  2. Use of Application Default Credentials with Service Account impersonation
  3. Use of Service Account Key (already implemented)
  4. Use of Service Account Key with Service Account Impersonation

Usage in configuration.yml file:

  1. Use of Application Default Credentials
data_source <SOURCE-NAME>:
  type: bigquery
  connection:
    use_context_auth: True
  1. Use of Application Default Credentials with Service Account impersonation
data_source <SOURCE-NAME>:
  type: bigquery
  connection:
    use_context_auth: True
    impersonation_account: <SA_EMAIL>
  1. Use of Service Account Key ...
  2. Use of Service Account Key with Service Account Impersonation
data_source my_database_name:
  type: bigquery
  connection:
    account_info_json: '{
        "type": "service_account",
        "project_id": "...",
        "private_key_id": "...",
      ...}'
    impersonation_account: <SA_EMAIL>

linderttobias avatar Jul 13 '22 14:07 linderttobias

CLA assistant check
All committers have signed the CLA.

CLAassistant avatar Jul 13 '22 14:07 CLAassistant

SonarCloud Quality Gate failed.    Quality Gate failed

Bug C 1 Bug
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 1 Code Smell

No Coverage information No Coverage information
0.0% 0.0% Duplication

sonarqubecloud[bot] avatar Jul 13 '22 14:07 sonarqubecloud[bot]

Hi @m1n0,

Regarding the duplicate lines: This has been fixed with commit SODA-914: remove redundant lines. Dont know why it does not show up anymore either

linderttobias avatar Sep 14 '22 06:09 linderttobias

hi @tooobsias, ah I see, I overlooked that one. Thank you!

m1n0 avatar Sep 14 '22 06:09 m1n0

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
No Duplication information No Duplication information

sonarqubecloud[bot] avatar Sep 14 '22 06:09 sonarqubecloud[bot]

@m1n0 Seems like I made it worse (and honestly dont know what I did to close the PR) I will reopen another Merge Request which addresses your suggestion regarding:

  1. Duplicate lines
  2. Selection of project_id/quota_project_id

linderttobias avatar Sep 14 '22 06:09 linderttobias