mamba icon indicating copy to clipboard operation
mamba copied to clipboard

Published 20 hours ago • verified publisher icon state-spaces

How to load mamba1's weight to mamba2 ?

Open EricLina opened this issue 1 year ago • 1 comments
trafficstars

Hello, is it possibile to directly load pretrained weight from mamba1 to mamba2?

EricLina avatar Jul 08 '24 14:07 EricLina

No, the model architectures are different

tridao avatar Jul 08 '24 15:07 tridao