java
java copied to clipboard
Could we supply the method that convert spark sql dataframe to tensorflow-java ByteNdArray object ?
Hi : Now I etl the raw data use spark sql generate the dataframe , I want to convert the spark dataframe object to ByteNdArray object for tensorflow model input
Converting from a data frame to a byte array has a lot of options on how you represent the data, columns and encoding. Do you have something specific in mind for each of those?
Converting from a data frame to a byte array has a lot of options on how you represent the data, columns and encoding. Do you have something specific in mind for each of those? -- dataframe -- text file ---ByteNdArray is easy ,but it need to write file to disk , but I want to use the tools that only need read memory dataframe cache meta-convert to ByteNdArray