nullname

nice! looks its indeed related to the rooted adb shell can you please try to run the cli with non-rooted shell?

> how to generate the missing `libQnnGgmlOpPackage_v79.so` for the qnn backend would be greatly appreciated. Regarding the missing `libQnnGgmlOpPackage`, it's kind of regression which introduced in this [PR](https://github.com/chraac/llama.cpp/pull/39), i've fixed...

> Could you provide guidance on how to resolve this signature verification issue given my constraints? Yeah, guesses it not cause by the unsigned so, since we'vee already enabled the...

> [@chraac](https://github.com/chraac) Thank you for your fix. I have successfully run the qnn-npu backend. Congrats! Now just the libhexagon_npu problem left, need some time to figure out the solution i...

> I noticed that the GGML_QNN_ENABLE_PERFORMANCE_TRACKING option does not take effect in the current CMakeLists.txt. Nice catch! will fix it on `dev-refactoring` > but the decoding speed is significantly slower...

Hi @Dantetang , Just forgot to say in my previous reply Regarding `err: 0x80000406` on `hexagon-npu` backend, please have another test on convenient 1. Check out the latest `dev-refactoring`, compiling...

From my local logcat output, there're always 2 `remote_handle64_open` calls, first one was failed becasue the unsigned PD, and then we'll enable the loading of unsigned PD with `remote_session_control`, and...

> > > > Hi [@TerryT9](https://github.com/TerryT9), I encountered the same issue and I'm not sure how to resolve it. Could you share how you solved it? > > > >...

hi @Gianthard-cyh, thought we can talk here

> I think writing some fused ops may help (e.g. flashattention), I'm now researching on this. but I believe the first thing to be done is to setup a profiling...