Matrix-Capsules-EM-Tensorflow
Matrix-Capsules-EM-Tensorflow copied to clipboard
Shared Weights in ConCaps Layer
Nice implementation of the capsule network with EM routing! However, I do have a question about the function mat_transform() in the ConvCaps layer. In your implementation the weights are not shared over the patches of capsules. It is true that in the paper, the authors didn't mention whether the weights should be shared in the ConvCaps layer. But judging from the number of parameters that is reported in the paper, if the weights are not shared, there will be way too many parameters to be trained. Check this out:
This paragraph is on page 5 of the paper.
It would also be reasonable to used shared weights if one wants to build deeper system, but I might be wrong about this.