Jeffrey Vo

To close this ticket I think we'd need to apply this fix to all other config values which expect a certain set of values (i.e. enums) but still parse as...

I'll rebrand this as a Spark function issue. Reference: https://spark.apache.org/docs/latest/api/python/reference/pyspark.sql/api/pyspark.sql.functions.size.html We want to support `size()` function on array + map types. Though we do have [`array_length`](https://github.com/apache/datafusion/blob/35b2e359f6703dedc6bf8ced3f0699d8a885d4df/datafusion/functions-nested/src/length.rs#L50-L72) already, this is meant...

I'll mark as good first issue, some pointers: - See existing Spark function PRs to see what needs to be done for adding Spark functions, e.g. #18018 - Can see...