Leon Lin

#### Which Delta project/connector is this regarding? - [ ] Spark - [ ] Standalone - [ ] Flink - [ ] Kernel - [x] Storage - [x] storageS3DynamoDB ##...

### Apache Iceberg version main (development) ### Please describe the bug 🐞 Current Glue catalog [create table implementation](https://github.com/apache/iceberg-go/blob/main/catalog/glue/glue.go#L231-L233) simply use Glue Create Table API to create the table in Glue...

Support configuring datafusion catalog in sqllogictest framework

1

### Is your feature request related to a problem or challenge? In #1764, the datafusion engine `create_catalog` is hard coded to be creating memory catalog. This limits the catalog used...

## Which issue does this PR close? - Relates to #1211 - Some of the changes are based on #581 - Will be refining the changes and break it down...

feat(table): Implement delete files snapshot producer API

1

### Description * Add delete files snapshot producer API for marking manifest entry as deleted based on a predicate * Being used as part of https://github.com/apache/iceberg-go/pull/518 * This only helps...

### Description * Work in progress POC for delete with copy on write * Will try to break down into smaller PRs for review once ready

### Apache Iceberg version main (development) ### Please describe the bug 🐞 ``` === RUN TestScanner/TestIsInFilterTable checked_allocator.go:186: LEAK of 64 bytes FROM github.com/apache/arrow-go/v18/arrow/array.(*bufferBuilder).resize+ab /home/runner/go/pkg/mod/github.com/apache/arrow-go/[email protected]/arrow/array/bufferbuilder.go:92 checked_allocator.go:186: LEAK of 64 bytes FROM...