armin976

Fatal error: [metal:: Device] Unable to load kernel gatherbfloat16int32_1_1_int

2

I'm trying to run a INT4 quantized model on A12X gpu but im getting this error when loading the model. Upon further inspection it seems like up to A14 chips...

Hello, I just wanted to propose a few additions to LM Studio. My first would be STT implementation, with the requirement being that the user must download an STT model...