What about stambecco for Llama 2?

[VioletRaven]

I was wondering if there is a need to adapt stambecco to Llama 2. At this time if I try to generate some text using "mchl-labs/stambecco-13b-plus" on top of "meta-llama/Llama-2-13b-hf" I get the following size mismatch error RuntimeError: mat1 and mat2 shapes cannot be multiplied (5932x5120 and 1x13107200) which should make sense.

Should I train a similar adapter from scratch or is there a way to make stambecco compatible to Llama 2?

Thank you in advance for sharing your opinion with me,

Andrea