Rolf Jagerman

Hi, > And later I will put out some modifies on glint, including the yarn patch which will ensure the glint could be run on yarn like a yarn application....

Hi @batizty, Thanks! This looks really nice! I haven't had the time yet to review it due to several projects and deadlines at work. I hope to review it some...

Still haven't found the time to do it, too many deadlines unfortunately :-( I'll let you know when I get around to it.

First work-in-progress done in https://github.com/rjagerman/glint/tree/spark-integration. This branch actually facilitates easier testing with spark (not necessarily localhost). For example, when running within a spark shell (and/or having access to the spark...

About **(1)**, good point about chained actors, this could be a very elegant solution. One of the reasons I want to integrate with Spark is because user-provided bytecode (whether this...

Actually, now that I look at the most recent documentation, there seems to have been some progress made on akka streams over network (e.g. TCP-based streaming): [http://doc.akka.io/docs/akka/2.4.10/scala/stream/stream-io.html](http://doc.akka.io/docs/akka/2.4.10/scala/stream/stream-io.html)

Although remapping is expensive, it's currently the only feasible thing to do with Glint since all matrices and vectors are stored as dense arrays. One of my goals right now...

I can't give an accurate time estimate at the moment. In terms of importance, I prioritize implementing fault tolerance over other features right now, so it could be on the...

Thanks for your interest in the project! Currently the parameter server runs stand-alone outside of Spark which means you'd have to run the master and servers on a cluster as...

I currently have not compared the performance to ps-lite (or any other parameter server for that matter), but it would be a very interesting thing to measure. If I had...