Peter Ke

# Description This PR ensures when using `S3DynamoDBLogStore`, temp commit files are only deleted when the DynamoDB log entry is deleted. Add `abort_commit_entry(version, tmp_commit)` to `LogStore` - By default, this...

feat(python): reading/writing transaction identifiers in python

2

# Description We'd like to read/write the delta transaction identifiers for stream processing. It seems that this is currently available to through rust but not python. This PR adds the...

# Description Fixes spurious `metadata` action when `write_deltalake` is called with mode `overwrite`, using a predicate and with a string partition column. This is undesirable because all concurrent writes will...

feat: read delta table using datafusion

4

# Description This adds a new method `datafusion_read` to `DeltaTable`, which reads the delta table using datafusion and returns pyarrow batches. This supports reading with SQL predicates, e.g. `dt.datafusion_read(predicate="id =...

feat: implement object store that caches to disk

17

# Description This adds a custom object store that caches files to disk. I've seen some discussions around but no implementation of it yet, so I'm opening this quick PR...