Raza Jafri

Results 68 comments of Raza Jafri

The two classes from this change that we rely on are FileFormat and FileSourceMetadataAttribute. We should get these changes for free IMO. @revans2 is my assessment correct?

The premerge failed due to ``` [2024-02-29T21:09:42.364Z] [INFO] Compiling 450 Scala sources and 58 Java sources to /home/ubuntu/spark-rapids/sql-plugin/target/spark330db/classes... [2024-02-29T21:09:48.866Z] [ERROR] /home/ubuntu/spark-rapids/sql-plugin/src/main/scala/com/nvidia/spark/rapids/GpuGetJsonObject.scala:19: object parsing is not a member of package util...

But #9876 is talking about replacing `TableCacheQueryStageExec` which we should never replace as I understand we shouldn't replace query stage execs?

Here are the steps to repro this locally ``` val data = Range(1,1000).toDF() data.write.parquet("/tmp/data.parquet") val df = spark.read.parquet("/tmp/data.parquet") df.cache.count df.write.format("delta").mode("overwrite").save("/tmp/delta_data") ```