Philip Yang

Results 9 comments of Philip Yang

Hi @ankamv , thank you for reporting the issue. Can you try doing the following in your pyspark script? `--jars /scala-logging-slf4j_2.11-2.1.2.jar,/scala-logging-api_2.11-2.1.2.jar` Also related, for testing purposes, please limit the size...

Hi @ankamv Can you try running your example locally on your dev box or laptop to see if it works?

Thank you for contributing to the project @allwefantasy!

@fsahba would you mind detach the notebook and re-attach, after the library is attached to the cluster? Thanks! In general it might be best if h5py is attached to the...

@RayTsui thank you for reporting the issue! @allwefantasy thank you for helping out! In addition, we also have some scripts/sbt-plugins we use to facilitate development process, which we put in...

@sdikby can you try `image_df.printSchema()`? It should show something like the following. ``` root |-- filePath: string (nullable = false) |-- image: struct (nullable = true) | |-- mode: string...

@sdikby that looks good. It will be great if you can try loading the file from a local file system instead of HDFS. Then see what `image_df.show()` looks like (it...

I was able to reproduce the same behavior using spark 1.6.0. @sdikby It is strongly recommended that you persist the data in parquet (instead of CSV). There are two issues...

@zsellami thank you for keeping updated with this issue. Would you like to pull the master branch and try the unit test again? `git rev-parse HEAD` should return dee8fbff74c807bdbf72edf3588d4d5f64f36b0b Please...