spark-tfrecord icon indicating copy to clipboard operation
spark-tfrecord copied to clipboard
verified publisher icon linkedin

write compression none invalid

Open wangxiao111 opened this issue 3 years ago • 1 comments

resultDF.write .mode(SaveMode.Overwrite) .format("tfrecord") .option("recordType", "Example") .option("compression", "none") .save(tfrecordPath)

wangxiao111 avatar Jan 18 '22 09:01 wangxiao111

I assume .option("compression", "none") means you don't need "compression". How about remove that option? By default, no compression is used, does that give you what you want?

junshi15 avatar Jan 18 '22 17:01 junshi15