xhzheng1895

Results 2 issues of xhzheng1895

Put KleidiAI files in folder source/backend/cpu/arm/kleidiAI/kai, download from arm gitlab and remain unchanged. Maybe will remove these files and download them when build. MNNKleidiAI.cpp is interface between MNN and KleidiAI....

分别跑了Qwen1.5-1.8B-Chat和Qwen-1_8B-Chat,报了类似的问题: 以Qwen1.5-1.8B-Chat举例: 使用tramsformers==4.31.0: ``` Traceback (most recent call last): File "/data_sdb/demos/mnn-llm/models/llm-export/llm_export.py", line 135, in load_hf self.model = AutoModelForCausalLM.from_pretrained(model_path, trust_remote_code=True).float().eval() File "/home/xinzhe02/.local/lib/python3.9/site-packages/transformers/models/auto/auto_factory.py", line 526, in from_pretrained config, kwargs = AutoConfig.from_pretrained( File...