MNN icon indicating copy to clipboard operation
MNN copied to clipboard

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/README....

Results 559 MNN issues
Sort by recently updated
recently updated
newest added

Dear Alibaba MNN Team, During our security audit of the MNN project, we have identified a potential integer overflow vulnerability in the `FileLoader::read()` method that could lead to memory corruption....

bug
Suggestion

As the title states, when trying to convert a tflite model to mnn I get the following error: The device supports: i8sdot:1, fp16:1, i8mm: 0, sve2: 0, sme2: 0 Start...

我按照下图的步骤,使用5月27号的master分支构建,带有QNN的Android库。指定MNN_FORWARD_NN,但是在创建session时,返回无法创建MNN_FORWARD_NN,使用了默认的CPU。测试机器为小米14(骁龙8Gen3)和小米12 pro(骁龙Gen1),都在高通支持QNN的SOC列表里。 想问下,除了下图所示的步骤,还需要配置什么吗?还是说目前的代码还无法使用QNN进行推理? ![Image](https://github.com/user-attachments/assets/419c5a39-a8af-4779-80db-16610b656935)

User

已经按照文档在配置文件中配置。没有产生效果

java.lang.UnsatisfiedLinkError: dlopen failed: cannot locate symbol "_Unwind_Resume" 升级到3.1.0之后 观测到部分 鸿蒙2、3的手机 基于安卓10 的 会报这个错误。之前的2.6.0release 没有这个问题.

question

我的手机不支持opencl

vulkan
llm

Dear developers. Could we get the recognized speech original text from the audio in the Qwen2.5-Omni" and "Qwen2-Audio" model? So we can help user to verify if the AI assistant...

User

配置命令:cmake -DMNN_BUILD_TOOLS=ON -DMNN_BUILD_BENCHMARK=ON -DCMAKE_SYSTEM_NAME=Linux -DCMAKE_SYSTEM_VERSION=1 -DCMAKE_C_COMPILER=mips-linux-gnu-gcc -DCMAKE_CXX_COMPILER=mips-linux-gnu-g++ -DCMAKE_INSTALL_PREFIX=./install/ -DMNN_LOW_MEMORY=ON -DMNN_ARM82=ON -DMNN_BUILD_SHARED_LIBS=OFF .. MIPS平台编译失败

wontfix

一台H20的Ubuntu服务器显示有打印信息 The device supports: i8sdot:0, fp16:0, i8mm: 0, sve2: 0, sme2: 0 使用 interpreter->getSessionInfo(session, MNN::Interpreter::BACKENDS, backendType) 获得实际的 backend 确认是vulkan 实际推理速度远低于CPU,查看gpu占用0 cpu跑满了。 相同代码在Android上能正常运行,Windows也能跑满GPU,请问有什么解决的方向嘛? | backend | (sec) | | --- |...

vulkan