dataproc-templates
dataproc-templates copied to clipboard
Dataproc templates and pipelines for solving simple in-cloud data tasks
Bumps [cryptography](https://github.com/pyca/cryptography) from 41.0.4 to 42.0.4. Changelog Sourced from cryptography's changelog. 42.0.4 - 2024-02-20 * Fixed a null-pointer-dereference and segfault that could occur when creating a PKCS#12 bundle. Credit to...
Update start.sh script to accept custom SA or use default SA. Also updated execution command from "gcloud beta dataproc batches submit pyspark" to "gcloud dataproc batches submit pyspark"
1. Remove Beta in gcloud cloud submit command 2. Add SA flag in submit command 3. Pass env variable for service account From a customer experience on floor (one of...
feat: PR to add support Partitioning for BigQueryToGSC Template. Issue: https://github.com/GoogleCloudPlatform/dataproc-templates/issues/827
1. add supoort for accepting sparksql as input 2. add support for accepting secrets from secret manager or accept as string and use a flag decode secrets before passing to...
Bumps [ch.qos.logback:logback-classic](https://github.com/qos-ch/logback) from 1.2.6 to 1.2.13. Commits 2648b9e prepare release 1.2.13 bb09515 fix CVE-2023-6378 4573294 start work on 1.2.13-SNAPSHOT a388193 Merge branch 'branch_1.2.x' of github.com:qos-ch/logback into branch_1.2.x de44dc4 prepare release...
Add support for a Python code formatter. That enable automatic formatting of Python code files to adhere to a consistent style, similar to what `spotless` does for Java templates. Consider...