Wenchen Fan
Wenchen Fan
@shardulm94 feel free to raise PRs! I think it makes sense to support DML as the `DataFrameWriter` API can also specify options
Do we have a strong reason to make this breaking change? How bad is it when calling `sentences` with two parameters?
`Option.when` is available after Scala 2.13
The master branch failure seems to be caused by the recent Spark refactors for Spark Connect. cc @hvanhovell
the 3.2 PR: https://github.com/delta-io/delta/pull/3603
To avoid risks, I've made this PR more surgical: only extract file system options from the table storage properties and only apply them when they are not defined in the...
> For example, given a conflict between options and a spark conf, I believe the former prevails? Yes, this is to maximize the backward compatibility.
When there is no pushdown benefit, is there any down side of changing the physical execution from `ArrayContains` to `InSet`?