Sumeet Gajjar
Sumeet Gajjar
[Core][Spark] Improve DeleteOrphanFiles action to return additional details of deleted orphan files
## What changes are proposed in this PR? This PR adds a new Interface `OrphanFileStatus` that indicates if an orphan file was deleted or not. In cases of failure during...
#3056 added support for `PURGE` flag to Spark. However, the corresponding `DROP TABLE` doc is outdated. This PR aims at documenting the updated behavior of the `DROP TABLE` DDL command....
#3056 added support for `PURGE` flag to Spark. However, the corresponding `DROP TABLE` doc is outdated. This PR aims at documenting the updated behavior of the `DROP TABLE` DDL command....
SPARK-40067 added Table#name() to the BatchScan node on SparkUI. With this improvement in place, for all DSv2 tables, SparkUI shows `BatchScan ` instead of uninformative `BatchScan`. In its current state,...