Piotr Sokólski

Looks like f75282a helped with `NamedInst.hs`, although to get it to compile the whole thing I also had to ``` diff diff --git i/src/Dyna/Backend/NoBackend.hs w/src/Dyna/Backend/NoBackend.hs index 6fa7a65..3bcfa62 100644 --- i/src/Dyna/Backend/NoBackend.hs...

Thanks Sinan, I had a brief look and I think this won't work with batching. I have this + a few other changes implemented in https://github.com/metavoiceio/metavoice-src/pull/46 so I'll close your...

Hey folks, I pushed a change that should fix the problems mentioned here, could you give it another go?

You need to change kv_cache type to "vanilla" in https://github.com/metavoiceio/metavoice-src/blob/main/fam/llm/serving.py#L188 to avoid depending on flash_attn

Strange error, does MPS support bfloat16? You could try setting `dtype="float16"` in the `common_config` dict in serving, looks like the bfloat is coming from the kvcache, while the model is...

@AbeEstrada You shouldn't be updating the types when it's torch.long, this is what causes errors down the line