Neil Johnson
Neil Johnson
The text to BigQuery templates have been superceded by the GCS to BigQuery templates which cover the same CSV functionality but also support formats other than CSV. In PR https://github.com/GoogleCloudPlatform/dataproc-templates/pull/695/commits/8aaad3fc968a27385f376229e5aa17e0f90879d6#r1140261859...
As we control parallelism via `numPartitions` we do not want Oracle to then run Spark queries in parallel. It would be really easy to overload a source system if this...
Requirements: - Support all SparkSQL CSV options when **reading** from cloud storage in Java templates. The code should be reusable/shared between the affected files. - Support all SparkSQL CSV options...
I tested Oracle based notebooks with an Oracle schema but imagine this affects all sources and targets. Test Oracle schema: ``` create user secure_user identified by "s#e c;u.r'e}" quota unlimited...