spark-tfrecord icon indicating copy to clipboard operation
spark-tfrecord copied to clipboard

Support for Spark 3.2.0+ with scala 2.13

Open sheilahu opened this issue 3 years ago • 2 comments

Hi,

I am wondering if there is plan to support spark with scala 2.13 and what the timeline looks like.

Thank you.

sheilahu avatar May 03 '22 02:05 sheilahu

This is a PR for Spark 3.2 + 2.12. I plan to merge it this weekend. Scala 2.13 is tricky, I will see how easy it is. We don't have a timeline for it. This project is user-driven: we are not actively developing it any more, but we rely on community's contribution for new features.

junshi15 avatar Jun 03 '22 15:06 junshi15

v0.5.0 (Spark 3.2 + Scala 2.13) has been published. https://search.maven.org/artifact/com.linkedin.sparktfrecord/spark-tfrecord_2.13/0.5.0/jar Please let me know if it works for you.

junshi15 avatar Jun 05 '22 13:06 junshi15