Fix/register partitioned tables in glue

Open firewall413 opened this issue 9 months ago • 4 comments

resolved issue when writing a new partition to glue for a table with the same schema would result in multiple glue schema versions (instead of just adding a partition)
resolved issue where when writing new partition to Glue: The schema of the file at external_read_location //*.parquet would be picked up instead of actual last written partition year=2024/month=03/day=20/*.parquet

Mar 20 '25 15:03 firewall413

@firewall413, hey nice to see you-- and thanks for putting this together!

Mar 20 '25 15:03 jwills

Still working on those failing tests, my bad, I'll finish up after my holidays!

Mar 20 '25 16:03 firewall413

Would it be possible to have a look at the Motherduck test? It seems to be blocking this PR

Sep 01 '25 14:09 firewall413

Would it be possible to have a look at the Motherduck test? It seems to be blocking this PR

i'll take a look after this run completes.

Sep 02 '25 13:09 hrl20