Forkoz

torch 2.5 is released. I cannot get nexfort working there.

Why not give us the option to select between them?

I'm going to get this running on my 8gb AMD card so I guess I should be careful and install requirements manually?

On linux it should work with ROCM and proper pytorch and environment. Just look at stable diffusion guides.

You are simply out of memory.. this isn't so much an issue. Set it to low vram.

Am third person. I don't need to undervolt (can't, not supported) but need to set cTDP state because it is limited to 1200mhz if you turn turbo off. The solution...

Exllama has no maxwell support.

I have issue with invalid symbol for some assert function in torch despite using cuda 12.6 conda, python 11 and torch 2.6. So pre-built wheel is not working for me...

I have the same issue on cuda 11.8 and torch 2.5. On cuda12 and 2.4.1 the extension loads normally. I'm not sure if I updated transformers there. edit: found the...

I have the same issue. Updated my extensions today and it stopped working. Can't load any checkpoints and always tries to downoad model.safetensors despite there being one there already. The...