simba icon indicating copy to clipboard operation
simba copied to clipboard

EinFFT as a channel mixer for other architectures

Open Xynonners opened this issue 1 month ago • 0 comments

Hi there,

I read the research paper, however one thing I was wondering is what would happen if one were to mate EinFFT to a different architecture, for example standard transformers instead of Mamba in place of the MLP/FF? I would understand if the EinFFT were built for Mamba specifically but would be interested to find the answer to this question.

Thanks

Xynonners avatar May 08 '24 04:05 Xynonners