yahoo
How to build with protobuf_2.4.1? The protobuf version is 2.4.1 in spark cluster which I can use.
@arundasan91 How to build CaffeOnSpark with protobuf_2.4.1? [ERRPR-LOG] as below:
17/01/16 15:44:19 ERROR yarn.ApplicationMaster: User class threw exception: java.lang.VerifyError: class caffe.Caffe$SolverParameter overrides final method getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet;
java.lang.VerifyError: class caffe.Caffe$SolverParameter overrides final method getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet;
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:760)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:455)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:367)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:360)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.yahoo.ml.jcaffe.Utils.GetSolverParam(Utils.java:13)
at com.yahoo.ml.caffe.Config.protoFile_$eq(Config.scala:70)
at com.yahoo.ml.caffe.Config.
@gagamihuya , Do Caffe work with Protobuf 2.4.1 ?
The required version is 2.5.0 right ?
I am not really sure if version 2.4.1 works. I will check and let you know. By the way, if you follow the Caffe Installation Instruction to install the prerequisites then you'll install a protobuf version greater than 2.5.0 when you do for req in $(cat requirements.txt); do pip install $req; done inside the caffe/python folder.
Thinks very much, @ Arun Das
I have locally build success and all test can be runinig successfully. I want to use CaffeOnSpark on a huge cluster which protobuf is 2.4.1.
2017-01-18 10:00 GMT+08:00 Arun Das [email protected]:
The protobuf version I have locally is 2.5.0.
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/yahoo/CaffeOnSpark/issues/222#issuecomment-273360733, or mute the thread https://github.com/notifications/unsubscribe-auth/AX2HnwNLhCMBJ3km_H09Pae1xVHcuZAYks5rTXJagaJpZM4LkUxh .
@gagamihuya , I can try to see if Protobuf V2.4.1 works but it will take some time as I am busy with some other work. I will let you know how it goes. Thanks.
From the error message, it is likely some protobuf java api has changed from 2.4.1 to 2.5.0. I have not tried 2.4.1 myself, but if BLVC caffe works with protobuf 2.4.1, then you will need to modify the java side code, especially the following file. You may have to modify other places as well.
https://github.com/yahoo/CaffeOnSpark/blob/master/caffe-distri/src/main/java/com/yahoo/ml/jcaffe/Utils.java#L9
