Stefan Kandic

[SPARK-47015][SQL] Disable partitioning on collated columns

1

### What changes were proposed in this pull request? Disable hive style partitioning on columns that are non default collated ### Why are the changes needed? With current implementation partitioning...

[SPARK-47009][SQL] Enable create table support for collation

1

### What changes were proposed in this pull request? Adding support for create table with collated columns using parquet ### Why are the changes needed? In order to support basic...

[SPARK-47007][SQL] SortMap function

1

### What changes were proposed in this pull request? Adding a new function `SortMap` ### Why are the changes needed? In order to add the ability to do GROUP BY...

[SPARK-48175][SQL][PYTHON] Store collation information in metadata and not in type for SER/DE

1

### What changes were proposed in this pull request? Changing serialization and deserialization of collated strings so that the collation information is put in the metadata of the enclosing struct...

[SPARK-48697][SQL] Add collation aware string filters

2

### What changes were proposed in this pull request? Adding a new classes of filters which are collation aware. ### Why are the changes needed? #46760 Added the logic of...

[SPARK-48739][SQL] Disable writing collated data to file formats that don't support them in non managed tables

2

### What changes were proposed in this pull request? Disable writing collated types to data sources that don't support them. However, spark managed tables should still work as the schema...

## Feature request #### Which Delta project/connector is this regarding? - [ ] Spark - [ ] Standalone - [ ] Flink - [X] Kernel - [ ] Other (fill...

[SPARK-49992][SQL] Session level collation should not impact DDL queries

1

### What changes were proposed in this pull request? This PR proposes not using session-level collation in DDL commands, specifically in CREATE TABLE v2 and ALTER TABLE ADD/REPLACE COLUMNS commands....

### What changes were proposed in this pull request? Add a new case in collation type casts for retrieving values from a map where the keys are collated strings. This...

### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? ###...