ps-lite icon indicating copy to clipboard operation
ps-lite copied to clipboard

[WIP] Simple Example of Async SGD

Open tqchen opened this issue 10 years ago • 0 comments

Based on what we have discussed, I think it is of great interest to show the following snippet of code.

  • Assume features are mapped consecutively(i.e. no Localizer is neede)
  • Assume all the node take its own partition of the data(i.e. no scheduler is needed)

Write a simple async SGD that defines ServerHandle and Worker Logic and that is all you need to do. This will demonstrate the core functionality of ps-lite without getting distracted in the other optimizations. And I think the efficiency should be fine for the case we described.

In the long run, we will want to move some of the specific optimization module(Localizer, WorkLoadPool) to dmlc-core eventually to design a user friendly API for more users to use them

tqchen avatar May 15 '15 21:05 tqchen