aphrodite-engine icon indicating copy to clipboard operation
aphrodite-engine copied to clipboard
verified publisher icon PygmalionAI

[Feature]: Support [RecurrentGemmaForCausalLM]

Open hmmsmoon opened this issue 1 year ago • 3 comments

🚀 The feature, motivation and pitch

I want use recurrentGemma in aphrodite-engine

ValueError: Model architectures ['RecurrentGemmaForCausalLM'] are not supported for now.

Alternatives

No response

Additional context

No response

hmmsmoon avatar Jun 12 '24 00:06 hmmsmoon

It's definitely planned. I haven't looked at the architecture yet, but I assume it's RNN-based, so #419 would probably make ways for it.

We have a lot more to work on at the moment, so this may take a while.

AlpinDale avatar Jun 12 '24 00:06 AlpinDale

It's definitely planned. I haven't looked at the architecture yet, but I assume it's RNN-based, so #419 would probably make ways for it.

We have a lot more to work on at the moment, so this may take a while.

Thank you. Take care of yourself.

hmmsmoon avatar Jun 12 '24 00:06 hmmsmoon

Please keep the issue open for tracking purposes.

AlpinDale avatar Jun 12 '24 00:06 AlpinDale