Direct download of Phi-3/3.5 task on Kaggle

[chienhuikuo]

MediaPipe Solution (you are using)

LLM Inference

Programming language

Android Java/Kotlin

Are you willing to contribute it

None

Describe the feature and the current behaviour/state

Would it be possible to provide the phi-3.task or phi-3.5.task for download directly on Kaggle?

Will this change the current API? How?

No response

Who will benefit with this feature?

No response

Please specify the use cases for this feature

To use phi-3/3.5 in an easy way.

Any Other info

I followed the documentation to create the phi-3.5-mini.task, but when I built the app and entered a prompt on my Android phone, I encountered the following error:

2024-10-11 09:25:05.516 24523-24599 tflite     com...diapipe.examples.llminference  E  Encountered unresolved custom op: odml.update_external_kv_cache.
                                                                                       See instructions: https://www.tensorflow.org/lite/guide/ops_custom 
2024-10-11 09:25:05.516 24523-24599 tflite     com...diapipe.examples.llminference  E  Node number 40 (odml.update_external_kv_cache) failed to prepare.

I sought assistance in the ai-edge-torch repo, but it didn't resolve the issue: https://github.com/google-ai-edge/ai-edge-torch/issues/293