Kyle Bendickson

Spark: Support truncate in FunctionCatalog

5

This is an offshoot of https://github.com/apache/iceberg/pull/5305 and partially closes https://github.com/apache/iceberg/issues/5349. Adds a `system.truncate` function that can be used in Spark SQL, as well as can be used as a `FunctionCatalog`...

API - Do not validate input length to String Truncate Transform on every call

3

Working on #5431, I noticed that we are validating the input length to the String truncate transform in every call for every value. However, the input length has already been...

Link REST request/response class Javadocs to OpenAPI Spec definitions

1

As part of the REST catalog, we have to implement several request / response classes. It would be nice to link the classes themselves to the OpenAPI document in the...

Possible timeline for an official release with support for `any` and `all`

1

Thank you so much for the work that you've all put in on this labeler action! I've been going through some of the apache repos and updating them to use...

Implement Initial Spark Structured Streaming Source

6

We currently cannot use Spark Structured Streaming for reading from an Iceberg table. This seems like a very common need. We were previously discussing the issue quite a lot back...

Capture the template parameter in the tests for TestIcebergInputFormat#Factory<T>

1

When going through and adding name format strings to our parameterized tests, I noticed a few parameters that came out looking wonky as the Parameters name substitution simply calls the...

Add in support for vectorized parquet reads on data files with row position (_pos) in the metadata column

2

Updating parameterized tests to have names in this PR https://github.com/apache/iceberg/pull/1539, I noticed that `TestSparkParquetReadMetadataColumns` had a `vectorized` parameter that is currently only tested with `false`. It is commented out for...

Guidance or Ideas on support ignoring certain classes of changes

2

## What happened? Feature request / tool usage assistance! ## What did you want to happen? The Revapi project defines a way to ignore certain types of changes, [for example,...