parallax
parallax copied to clipboard
snuspl
A Tool for Automatic Parallelization of Deep Learning Training in Distributed Multi-GPU Environments.
#### Failure Logs Hi, Good day. I have tried to run example: Simple in your code. I have an issue when I was running the example. CUDA Toolkit 9.0 CuDNN...
### Things to Change Add test set to test: - [ ] Correctness (make models deterministic, and see compare the exact numbers) - [ ] Throughput - [ ] Rule-wise...
### Things to Change To implement RNN models, a user can represent the RNN hidden state with Variable to correctly pass it between multiple session runs. However, current parallax just...
### Things to Change Since current in-graph replication logic makes both system and user-API complicated, we can explore if between-graph replication for PS would make sense in terms of performance....
### Things to Change According to NMT, embedding parameter goes to a worker if the number of embedding partitions is one. It happens in the Parallax, too. ### Current Behavior...