Performance Issue On Android

[mcmah309]

Hello,

First I'll say, really impressed by this library and looking forward to TTS!

I ran the example project on my android pixel 7 (Same one you used) and I am not seeing the same performance that was presented in the video here https://www.youtube.com/watch?v=SBaSpwXRz94 . I am getting about 1 word every 20 seconds.

I used the tinyllama-1.1b-chat-v1.0.Q2_K.gguf model found here. https://huggingface.co/TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF/tree/main

I tried on a few more models and got the same issue.

Was there a specific model needed to achieved this? Or any specific configuration?

Run command: flutter run -d 28301FDH200MY4 --release

Device Info:

[
  {
    "name": "Pixel 7",
    "id": "28301FDH200MY4",
    "isSupported": true,
    "targetPlatform": "android-arm64",
    "emulator": false,
    "sdk": "Android 14 (API 34)",
    "capabilities": {
      "hotReload": true,
      "hotRestart": true,
      "screenshot": true,
      "fastStart": true,
      "flutterExit": true,
      "hardwareRendering": false,
      "startPaused": true
    }
  }
]