cuda version of mLSTM

Open bio-mlhui opened this issue 1 year ago • 2 comments

will there be a cuda version of mLSTM? The mLSTM is O(n^2) complexity in both training and inference. I got OOM error in 24GB GPU, the context_lenght is set to 512, batch_size is 12, dim is 320, heads=10.

Jun 07 '24 06:06 bio-mlhui

Did you have the erro when config the .yaml： RuntimeError: Error building extension 'slstm_HS64BS8NH1NS4DBfDRbDWbDGbDSbDAfNG4SA1GRCV0GRC0d0FCV0FC0d0

Jun 07 '24 06:06 liujike

no, you can try delete this temporary folder and rebuild

Jun 07 '24 06:06 bio-mlhui