Shuai Li
Shuai Li
Hi, I have uploaded my code of IndRNN to GitHub as well as some running examples using it. https://github.com/Sunnydreamrain/IndRNN_Theano_Lasagne Since there are a few items in your to-do list, I...
Hi, At the following line for gradient backpropagation, `float cur = *(grad_last + col);`. `cur` should be 0? `grad_last` is the gradient of the last cell state `c_t`. So when...
As in the following line, it seems that when "batch_norm_use_averages" is True, mean and inv_std is not updated with the statistics of the current batch? https://github.com/Lasagne/Lasagne/blob/master/lasagne/layers/normalization.py#L289 Is this developed on...
Hi, From the paper "layer normalization", in section 3.1, layer normalization for rnn is used for the sum of the weighted input and weighted hidden. In the code of lngru,...
Hi, I have uploaded my code of IndRNN to GitHub as well as some running examples using it. https://github.com/Sunnydreamrain/IndRNN_Theano_Lasagne Since there are a few items in your to-do list, I...
Hi, I have uploaded my code of IndRNN to GitHub as well as some running examples using it. https://github.com/Sunnydreamrain/IndRNN_Theano_Lasagne Since there are a few items in your to-do list, I...