AutoEncoder mirroring by transpose

[cbalint13]

Dear Nitish,

In your example of ae, also in the case we have 3 or more layers, will be the second half automaticaly mirrored using transpose of weights ? My tests concluded that not really, by visualising and comparing the weights. In a simple case of e.g. [ly1]*768-[ly2]512-[ly3]768 , [ly3] is declared tied_to: [ly1] , all obviously using SQUARED_LOSS global, but question is how to tell [ly2] to take weights transposed from ly1<->ly2 always. I found the "tied_transpose: true" directive but seems to not work as expected or i dont know what is it doing.

Thank You.