spark-tfrecord icon indicating copy to clipboard operation
spark-tfrecord copied to clipboard

encountered a FileAlreadyExistsException when trying to save array of arrays of arrays (3d array)

Open GraceHLiu opened this issue 4 years ago • 1 comments

I got a FileAlreadyExistsException when I was trying to save a pyspark dataframe that has 3d array columns. The saving worked for me when I only had 1d, 2d, and scalars in the dataframe. Is there any plan to support 3d arrays in the near future?

GraceHLiu avatar Sep 29 '21 21:09 GraceHLiu

Thanks for your feedback. We don't have a plan to support 3D array.

junshi15 avatar Sep 30 '21 00:09 junshi15