parallax
parallax copied to clipboard
Published
20 hours ago •
snuspl
snuspl
Embedding parameter placement in NMT model
Things to Change
According to NMT, embedding parameter goes to a worker if the number of embedding partitions is one. It happens in the Parallax, too.
Current Behavior
PS fails when the number of embedding partitions is one.
Expected Behavior
Work well regardless of the number of embedding partitions.
Failure Information (for bugs)
Failure Logs
How to Reproduce
Run NMT example with "num_embedding_partitions=1"
