MNN icon indicating copy to clipboard operation
MNN copied to clipboard
verified publisher icon alibaba

Why Replace the KleidiAI macro with the hint config

Open andyt9527 opened this issue 2 months ago • 1 comments

commit f699ca2842cf9752d0cd90a4a5b3664c8e893ba8 Author: yanzhang [email protected] Date: Fri Aug 1 17:19:36 2025 +0800

Replace the KleidiAI macro with the hint config

Signed-off-by: yanzhang <[email protected]>
Change-Id: I9dcc4f68e1e67a11266b66589006650b197cde1e

在这个 patch 中增加了一个 kleidiai 的 hint config 控制，但是并没有在 llm_demo llm_bench中提供使能开关。会导致在 arm64设备上 cpu 推理 性能下降

andyt9527 avatar Oct 16 '25 11:10 andyt9527

遇到同样的问题，llm_bench 没法使能 kleidiai。 MNN版本 3.2.4

OldDaddy9 avatar Nov 03 '25 12:11 OldDaddy9