Orpheus in Swift example - Layer shapes

[BenLumenDigital]

I'm trying to get Orpheus working in Swift here: https://github.com/Blaizzy/mlx-audio/pull/84

But I can't understand some layer shape stuff.

There is an embedding layer with hidden_size of 3072.

But when I run the model, I see a shape of 384.

And I can't see any way that this should be projected... what am I missing here!?

[lucasnewman]

It's difficult to debug this without seeing the code -- do you have a branch somewhere with it?

[Blaizzy]

There is a PR here from @BenLumenDigital