build failed with spark 1.6.1, how should i config the pom.xml in caffe-grid?

[gagamihuya]

[INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] caffe .............................................. SUCCESS [ 0.003 s] [INFO] caffe-distri ....................................... SUCCESS [01:53 min] [INFO] caffe-grid ......................................... FAILURE [ 01:01 h] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:03 h [INFO] Finished at: 2017-01-10T10:18:36+08:00 [INFO] Final Memory: 39M/1963M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal on project caffe-grid: Could not resolve dependencies for project com.yahoo.ml:caffe-grid:jar:0.1-SNAPSHOT: The following artifacts could not be resolved: org.apache.spark:spark-core_2.10:jar:1.6.1, org.apache.spark:spark-sql_2.10:jar:1.6.1, org.apache.spark:spark-mllib_2.10:jar:1.6.1: Could not transfer artifact org.apache.spark:spark-core_2.10:jar:1.6.1 from/to scala-tools.org (http://scala-tools.org/repo-releases): Received fatal alert: protocol_version -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :caffe-grid make64: *** [build] Error 1

[junshi15]

Did you change the pom file before compile? mvn could not find spark-core_2.10 in maven repo.

[gagamihuya]

I have build success using the default pom file, Think you @Jun Shi

2017-01-12 7:40 GMT+08:00 Jun Shi [email protected]:

Did you change the pom file before compile? mvn could not find spark-core_2.10 in maven repo.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/yahoo/CaffeOnSpark/issues/216#issuecomment-272031195, or mute the thread https://github.com/notifications/unsubscribe-auth/AX2Hn25DstvzC2AB0hXtJKAfOvQ1f9rxks5rRWhUgaJpZM4Le-Dh .

[javadba]

Please explain what was done here: I am experiencing same error. BTW I am using spark2

mvn -Dspark2 package -DskipTests

Actually same error happens either way including

mvn package -DskipTests

[javadba]

I ran the following in the caffe-distri directory

mvn -Dspark2 -DskipTests install

It seemed to install successfully: and we can see the jars in maven repo:

caos@mithrandir:/git/caos/caffe-distri$ ll /home/caos/.m2/repository/com/yahoo/ml/caffe-distri/0.1-SNAPSHOT/caffe-distri-0.1-SNAPSHOT.jar -rw-rw-r-- 1 caos caos 867030 Mar 4 07:38 /home/caos/.m2/repository/com/yahoo/ml/caffe-distri/0.1-SNAPSHOT/caffe-distri-0.1-SNAPSHOT.jar

Now let's build the caffe-grid

caos@mithrandir:/git/caos/caffe-distri$ cd ../caffe-grid/ caos@mithrandir:/git/caos/caffe-grid$ mvn -Dspark2 -DskipTests package [INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for com.yahoo.ml:caffe-grid:jar:0.1-SNAPSHOT [WARNING] The expression ${version} is deprecated. Please use ${project.version} instead. [WARNING] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [WARNING] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [WARNING] [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building caffe-grid 0.1-SNAPSHOT [INFO] ------------------------------------------------------------------------ Downloading: http://scala-tools.org/repo-releases/com/yahoo/ml/caffe/0.1-SNAPSHOT/maven-metadata.xml [WARNING] Could not transfer metadata com.yahoo.ml:caffe:0.1-SNAPSHOT/maven-metadata.xml from/to scala-tools.org (http://scala-tools.org/repo-releases): Received fatal alert: protocol_version Downloading: http://scala-tools.org/repo-releases/com/yahoo/ml/caffe/0.1-SNAPSHOT/caffe-0.1-SNAPSHOT.pom [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 3.039 s [INFO] Finished at: 2017-03-04T07:39:32-08:00 [INFO] Final Memory: 18M/481M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal on project caffe-grid: Could not resolve dependencies for project com.yahoo.ml:caffe-grid:jar:0.1-SNAPSHOT: Failed to collect dependencies at com.yahoo.ml:caffe-distri:jar:0.1-SNAPSHOT: Failed to read artifact descriptor for com.yahoo.ml:caffe-distri:jar:0.1-SNAPSHOT: Could not transfer artifact com.yahoo.ml:caffe:pom:0.1-SNAPSHOT from/to scala-tools.org (http://scala-tools.org/repo-releases): Received fatal alert: protocol_version -> [Help 1] [ERROR]