EvoNorm icon indicating copy to clipboard operation
EvoNorm copied to clipboard

apply to evonorm1d(sequence data)

Open small-Qing opened this issue 2 years ago • 1 comments

Hi, i have read your code,but i want to know whether evo_norm could be used for sequence-data, for example, the dims in data just likes batch_size, seq_len, embedding_dims.
In other words, N, C, H, W = x.size(), does C correspond to embedding_dims?

small-Qing avatar Jul 06 '22 13:07 small-Qing

@small-Qing for sequence data, we would have to implement a version Evonorm1d since the 2d version expects a 4-dimensional tensor of the shape <N,C,H,W>. This shouldn't be that difficult to implement, but I can't commit to building it in the next 2 weeks.

digantamisra98 avatar Jul 08 '22 14:07 digantamisra98