llama.cpp
llama.cpp copied to clipboard
Feature Request: 推理minicpmv时,encoding_image_with_clip耗时很久
Prerequisites
- [x] I am running the latest code. Mention the version if possible as well.
- [x] I carefully followed the README.md.
- [x] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
- [x] I reviewed the Discussions, and have a new and useful enhancement to share.
Feature Description
在高通平台termux,运行ndk编译的库,有增加OpenCL,推理miniCPMV-2.6单张图片和一段文字“请描述图片中人的动作”。总耗时60秒,其中encoding_image_with_clip就花了51秒
Motivation
希望看下是否为该仓库源代码的问题
Possible Implementation
No response