Jun Shi
Jun Shi
The .tgz file will be shipped to all executors. Make sure 1) your .tgz file contains lmdbjni.so 2) set the library path as shown by @anfeng
in YARN mode, spark.executor.cores = 1. https://spark.apache.org/docs/latest/configuration.html
how many executors were you using? For debug purpose, you may want to use one executor (if you are not using 1 executor already). Also, please verify your data frame...
travis failed, although the error does not seem to be related to the PR.
CaffeOnSpark will be slower than caffe-public on a single machine. See the discussion [here](https://github.com/yahoo/CaffeOnSpark/issues/259).
You may get more specific help if you can elaborate your issues. If you have more than one infiniband card in a single box, one the first one will be...
Were you able to run the examples in Wiki? You command appeared to be correct, but Spark was complaining about not able to find solver.prototxt.
Glad to know the examples worked for you. I don't know why your command failed.
You did not define source_class? Depending on your source data format, you need to tell CaffeOnSpark about it, e.g. https://github.com/yahoo/CaffeOnSpark/blob/master/data/lenet_cos_train_test.prototxt#L10-L12
We added a wrapper around some of the Caffe functions to fit in the Spark framework. The output you see from CoS should be equivalent to what you see from...