Shixiong Zhu

@bogdanmrusu do we know why running on GitHub Actions doesn't hit the issue?

Just took a look. The testing flag is set in `beforeAll`: https://github.com/apache/spark/blob/v3.3.0/core/src/test/scala/org/apache/spark/SparkFunSuite.scala#L86 However, the Metadata object is created before `beforeAll` here: https://github.com/delta-io/delta/blob/e65496665fd1b187b488ab77f79986a8b381ee16/core/src/test/scala/org/apache/spark/sql/delta/ActionSerializerSuite.scala#L218 That's why it fails. It doesn't fail on...

@jkylling the issue we found is EMR 6.6 shipped a bad hadoop-aws jar. We hit the following issue when using EMR 6.6: ``` java.lang.NoSuchMethodError: org.apache.hadoop.util.SemaphoredDelegatingExecutor.(Lcom/google/common/util/concurrent/ListeningExecutorService;IZ)V at org.apache.hadoop.fs.s3a.S3AFileSystem.create(S3AFileSystem.java:813) ``` The constructor...

@mmengarelli Could you resolve the conflicts?

In addition, if `DeltaSparkSessionExtension` is not set, nothing will be caught.

@kpe This is not in Spark yet. We are talking to the Spark community and hope we can get this syntax supported in Spark 3.4. It's a SQL standard so...

@dragongu Done. Thanks for offering the help!

@YannByron We have to create our own parser as we don't plan to follow Spark's current `show partitions` format. It's coming from legacy hive format and it's not user friendly....

> We only want properties that are prefixed with `delta.` to be written to the delta log, and we obviously want to preserve their case. As this API is for...

@edmondo1984 @zpappa Here is a unit test to show the bug: ```scala test("delta table property") { for (setProp val path = dir.getCanonicalPath() setProp match { case "CREATE TABLE" => sql(s"CREATE...