abhinavs

Results 3 comments of abhinavs

I tried using spark-tfrecord_2.12-0.3.0.jar with Spark 3.3 (albeit a managed version on Azure) & the job fails with error Caused by: java.lang.AbstractMethodError: org.apache.spark.sql.execution.datasources.OutputWriter.path()Ljava/lang/String; at org.apache.spark.sql.execution.datasources.SingleDirectoryDataWriter.$anonfun$write$2(FileFormatDataWriter.scala:177) at org.apache.spark.sql.execution.datasources.SingleDirectoryDataWriter.$anonfun$write$2$adapted(FileFormatDataWriter.scala:177) at scala.collection.immutable.List.foreach(List.scala:431) at...

Somehow I must have missed this as Spark 3.3 is not explicitly called out. I didn't try 0.5.x as it targets scala 2.13 and the spark I am using is...

@thesuperzapper Assuming the project is live, any idea when would the next release be available?