capsule-networks
capsule-networks copied to clipboard
Can the 8 32-channel conv be replaced with a single 256-channel conv in PrimaryCapsule?
Thanks for sharing the nicely written code.
I wonder that is there any difference between using 8 32-channel convlayer and a single 256-channel convlayer? It seems like the "In total PrimaryCapsules has [32*6*6] capsule outputs (each output is an 8D vector)" mentioned in Dynamic Routing Between Capsules can be simply implemented as a 256-channel convlayer followed by a reshaping operation.
But I haven't seen anyone using 256-channel conv so far. Am I thinking wrong?
I have used such an implementation for the PrimaryCaps layer in my repository (https://github.com/gchochla/caps/blob/master/caps/layers.py#L33). I had to use an extra variable to separate them for the output of the layer though.