Thomas Powell

Add Conjure Error Code for 401 unauthorized responses

3

## Motivation I'd like to be able to define a Conjure error whose HTTP status code maps to a 401. ## Proposal Add a `NOT_AUTHORIZED` value to https://github.com/palantir/conjure/blob/fc68a07b5780858521d2b50382c1a3c4b0b61bad/conjure-api/src/main/conjure/conjure-api.yml#L31.

Mark Spark33BigQueryPushdown as supporting Spark 3.4 and 3.5

1

I see in https://github.com/GoogleCloudDataproc/spark-bigquery-connector/pull/1115/files#diff-87a38904e32856997cfefcedf7cdda864282b53af31200a1a22da4148a6399d0R40 that Spark 3.5 (and Spark 3.4) libs are relying on `spark-3.3-bigquery-pushdown` libs. However, `Spark33BigQueryPushdown#supportsSparkVersion` only declares it supports 3.3. This means `BigQueryConnectorUtils#disablePushdownSession` does not work on...

Support spark.sql.datetime.java8API.enabled

4

Support Spark's `spark.sql.datetime.java8API.enabled` property when `true`. This expects dates and timestamp to be `java.time.LocalDate` and `java.time.Instant` respectively rather than the `java.sql` equivalents.

### What changes were proposed in this pull request? `Not(IsNull(x))` is made semantically equivalent to `IsNotNull(x)` and vice versa. ### Why are the changes needed? The following would return `false`...

Allow S3 URL style to be configured from environment

3

Adding `DUCKDB_S3_URL_STYLE` environment variable for consistency with the other `s3_X` configuration parameters in the `s3fs` extension.

## Changes Motivation here is to support connecting to proxies using `https` scheme not just default `http` which is used in `HttpHost` when no scheme is explicitly provided. ## Tests...

Respect snapshotTimeMillis when doing optimized count

6

Are there existing ETE tests where it would make sense to include something for this `snapshotTimeMillis`?