cruise
cruise copied to clipboard
Compare the methods for concurrent model access
Subissue of #821
We've been working on Trainers that run with multiple threads. When accessing and updating model parameters, three type of synchronization are possible:
- non-hogwild: shared model with lock
- hogwild: shared model without lock
- thread-local: unshared model per thread without lock
Current ModelAccessor
implementation supports 3. We should compare all versions to see how one method compels the others and set it as the default implementation.