Mingzhou Zhou comments

Results 3 comments of


                                            Mingzhou Zhou

java.lang.ClassNotFoundException: Failed to find data source: tfrecord. Please find packages at http://spark.apache.org/third-party-projects.html

Hi @Ethanhack , please use the correct spark versions as shown in the [README.md](https://github.com/linkedin/spark-tfrecord#readme),you may want to use spark 2.4, we don't support spark 2.2. ``` Version 0.1.x targets Spark...

Spark 3.3 support?

@abhinavsarkari you may want to try 0.5.x for spark 3.3 as the README shows. ``` Version 0.1.x targets Spark 2.3 and Scala 2.11 Version 0.2.x targets Spark 2.4 and both...

spark 读取 tfrecord文件，解析tf.train.Feature(bytes_list=tf.train.BytesList(np.array(feature, dtype=np.float32).tobytes())) 文件字节码异常

Hello, I think your issue is related to spark encoding, can you try the `charset` option? This stackoverflow thread may be helpful to you: https://stackoverflow.com/questions/51957742/read-a-bytes-column-in-spark