glint

glint copied to clipboard

merge yarn-support

1

rikima

Feature/hdfs save

1

* add save operation to store matrix/vector into hdfs * add hdfs deps on build.sbt, and the hadoop version should be 2.7.2 or higher

batizty

Need Save Operation to store the big vector/matrix into HDFS

1

The Problem which is used parameter server, the weight vector/matrix is huge and sparse. Need Save Operation to store weight into HDFS.

batizty

Yarn support

8

Hi rjagemen, Could you please help me to review the request? All codes are tested on online in my cluster environment. Any question is welcome and appreciate your previous work....

batizty

Got runtime issues when using spark-shell

2

I compiled Glint using Scala 2.10.6 and successfully got the jars. Then I try to run the example in spark.md, however, I got this error when initializing the client. @transient...

fenganli

Hey Rolf! I am struggling to setup glint on a standalone spark cluster. i am following your tutorial with one master and one server. (and i use the standard conf...

citizenkeynes

How to try it out in cluster env like YARN

4

Hi Rolf, I saw your comment in ticket: SPARK-6932. I'm excited and very interested in this project. I seriously believe Parameter Server is an essential piece to further scale ML...

timyitong

Akka Actor Error when initializing Glint Client

2

I am trying this implementation of Glint with Apache Flink. I am rather new to Akka and can not figure out the following error message: `java.lang.NoSuchMethodError: akka.pattern.AskableActorRef$.$qmark$default$3$extension(Lakka/actor/ActorRef;Ljava/lang/Object;)Lakka/actor/ActorRef; at glint.Client.(Client.scala:40) at...

mnoumanshahzad

why make "push" as an “accumulator” rather than “replacer”？

6

Hi, all, It is so exciting to see this project！ Recently I have been working on huge dimension machine learning, and I found Parameter Server is indispensable. As simply viewing...

ljzzju

Can glint support BigInt type?

1

I have been playing around with glint for a few weeks and am excited about it's potential. However the counts I want to eventually push to the parameter server are...

craighagerman