EvoNorm
EvoNorm copied to clipboard
apply to evonorm1d(sequence data)
Hi, i have read your code,but i want to know whether evo_norm could be used for sequence-data, for example, the dims in data just likes batch_size, seq_len, embedding_dims
.
In other words, N, C, H, W = x.size()
, does C
correspond to embedding_dims
?
@small-Qing for sequence data, we would have to implement a version Evonorm1d
since the 2d version expects a 4-dimensional tensor of the shape <N,C,H,W>
. This shouldn't be that difficult to implement, but I can't commit to building it in the next 2 weeks.