ktransformers icon indicating copy to clipboard operation
ktransformers copied to clipboard
Published 4 weeks ago • verified publisher icon kvcache-ai

LLaMA‑Factory sft只能使用amx指令集吗？

Open crossxxd opened this issue 1 month ago • 3 comments

Reminder

  • [x] I have read the above rules and searched the existing issues.

System Info

cpu不支持amx指令集

Reproduction

将yaml中KSFTExpertsCPU算子的backend AMXInt8删除以后，报Illegal instruction

Others

No response

crossxxd avatar Nov 26 '25 11:11 crossxxd

对的，目前应该支持 amx

KMSorSMS avatar Nov 27 '25 10:11 KMSorSMS

同样的问题，能否支持非amxcpu，模型是bf16，模型换成gguf可行吗

biao001 avatar Nov 28 '25 12:11 biao001

微调不支持，目前只有 amx

KMSorSMS avatar Nov 28 '25 13:11 KMSorSMS