Jun Shi

Results 115 comments of Jun Shi

The problem is not only the schema. Even you provide the schema, the reader will still fail. So unfortunately the null values are not supported well. My suggestion is to...

Thanks for your feedback. We don't have a plan to support 3D array.

df2 is the output of the groupBy operation, which is "RelationalGroupedDataset". There is no TFRecord equivalence for this kind of data schema. TFRecord supports very limited schema. It is for...

If you already have the RDD, then you can create the schema, then use `createDataFrame` as shown here. https://stackoverflow.com/questions/29383578/how-to-convert-rdd-object-to-dataframe-in-spark

"TensorFlowInferSchema" only infers the schema. Is that what you need? I am not familiar with Spark Java API, but can you call scala function from Java? If you want to...