dbt-bigquery icon indicating copy to clipboard operation
dbt-bigquery copied to clipboard

[ADAP-1090] [Feature] Adding Pyspark job options to the model config

Open gbmarc1 opened this issue 2 years ago • 0 comments

Is this your first time submitting a feature request?

  • [X] I have read the expectations for open source contributors
  • [X] I have searched the existing issues, and I could not find an existing issue for this feature
  • [X] I am requesting a straightforward extension of existing dbt-bigquery functionality, rather than a Big Idea better suited to a discussion

Describe the feature

Adding pyspark job options to the model config to alter the job behaviour on the model level. I suggest adding the dataproc_pyspark_job field to the model config which is a dictionary with the following fields.

Describe alternatives you've considered

No response

Who will this benefit?

No response

Are you interested in contributing this feature?

yes

Anything else?

PR -> https://github.com/dbt-labs/dbt-bigquery/pull/1048/files

gbmarc1 avatar Jan 04 '24 19:01 gbmarc1