llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

Feature Request: 推理minicpmv时,encoding_image_with_clip耗时很久

Open EnzhiZhou opened this issue 4 days ago • 2 comments

Prerequisites

  • [x] I am running the latest code. Mention the version if possible as well.
  • [x] I carefully followed the README.md.
  • [x] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
  • [x] I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

在高通平台termux,运行ndk编译的库,有增加OpenCL,推理miniCPMV-2.6单张图片和一段文字“请描述图片中人的动作”。总耗时60秒,其中encoding_image_with_clip就花了51秒

Motivation

希望看下是否为该仓库源代码的问题

Possible Implementation

No response

EnzhiZhou avatar Feb 18 '25 09:02 EnzhiZhou