GB

I noticed it was removed recently myself. I left it in on my fork and love that aspect too. Not sure why it was removed??? https://github.com/groovybits/gaib/blob/main/utils/makechain.ts You can see how...

This may help https://github.com/pytorch/pytorch/pull/114183 and gets me past an error that looks similar to yours.

+1 for this :) need this so bad on my Mac Ultra M2! Mimic3 TTS is just not great and OpenAI costs a bit much for 24/7 use. I may...

I seem to have mine up to a point where flash-attn isn't available on my Mac and has worked beyond xformers. I had to use python3.11 for some reason, my...

> You need to change kv_cache type to "vanilla" in https://github.com/metavoiceio/metavoice-src/blob/main/fam/llm/serving.py#L188 to avoid depending on flash_attn Thank you! Update: It hits an issue with the float type used, even when...

Looks the same to me on an M2, I get the.... ``` failed to run MBD. reason: Placeholder storage has not been allocated on MPS device! ``` Good job! Seems...

Yes something still is wrong, I hit it with the error off the previous posted branch with work towards it... ``` failed to run MBD. reason: Placeholder storage has not...

I had to increase docker server memory ram allocated quite a bit, so now it loads (i was getting a 137 exit code until I fixed that by increasing ram...

Yes that sounds good, I have this branch that I am working off of https://github.com/metavoiceio/metavoice-src/compare/main...groovybits:metavoice-src:docker and will make a PR when it is ready. (note I am on metal/mps and...

FYI: I can get it building with my Mac native now, when running I run into this issue. The docker seems to give the previous mentioned error so looks more...