dbt-bigquery
dbt-bigquery copied to clipboard
[ADAP-1090] [Feature] Adding Pyspark job options to the model config
Is this your first time submitting a feature request?
- [X] I have read the expectations for open source contributors
- [X] I have searched the existing issues, and I could not find an existing issue for this feature
- [X] I am requesting a straightforward extension of existing dbt-bigquery functionality, rather than a Big Idea better suited to a discussion
Describe the feature
Adding pyspark job options to the model config to alter the job behaviour on the model level. I suggest adding the dataproc_pyspark_job field to the model config which is a dictionary with the following fields.
Describe alternatives you've considered
No response
Who will this benefit?
No response
Are you interested in contributing this feature?
yes
Anything else?
PR -> https://github.com/dbt-labs/dbt-bigquery/pull/1048/files