Thijs

We add read support for VARIANT with this PR, and upgrade the Spark test dependency to 4.0 so we can generate test data. This produces JSON from the read Variant...

Iceberg Table insert can't handle supplied columns

2

First raised here: https://github.com/duckdblabs/duckdb-internal/issues/5755 ```sql require-env ICEBERG_SERVER_AVAILABLE require avro require parquet require iceberg require httpfs require aws # Do not ignore 'HTTP' error messages! set ignore_error_messages statement ok CREATE SECRET...

### Spec > If metrics show that a delete file has no rows that match a scan predicate, it may be ignored just as a data file would be ignored...

We [recently](#327) added support for the https://iceberg.apache.org/puffin-spec/#deletion-vector-v1-blob-type delete format At the end of this deletion vector blob is a CRC-32 checksum, from the spec: > A CRC-32 checksum of the...

[Credentials] Enabling refresh for vended credentials / bearer tokens

1

@samansmink > Refresh does exist, but currently needs to be enabled explicitly, see: https://github.com/duckdb/duckdb-httpfs/blob/39779f89b16d0a35f04d3cfaf868e6366a2102f0/extension/httpfs/s3fs.cpp#L718 ```c++ //! Function that will automatically try to refresh a secret bool CreateS3SecretFunctions::TryRefreshS3Secret(ClientContext &context, const SecretEntry...

Iceberg has the UNKNOWN type for this, which is useful for schema evolution when a column isn't assigned any data yet, and we don't yet know what the type will...