MeloTTS icon indicating copy to clipboard operation
MeloTTS copied to clipboard

TODO list: if you have plan to support arm platform hardware accelerate, like arm executorch/xnnpack.

Open HarryBXie opened this issue 11 months ago • 2 comments

I have one quick setup on RK3588 platform, which includinng 4+4 arm v8 CPU cores. There have one positive result with good RTF on arm CPU.

Want to know if there have plan to optimize performance on arm CPU, based on edge AI.

HarryBXie avatar Jan 21 '25 09:01 HarryBXie

What do you mean? You can just set device=CPU, or is there a way to make a X100 speed up?

yukiarimo avatar Jan 21 '25 21:01 yukiarimo

Hi, @yukiarimo,

Thank you for your quick response. I deploy Melo TTS on edge device, and the RTF reach to ~2.0, under Chinese(mix English) condition. That is great. Besides, I find that CPU usage is ~50%, both on arm an x86 cpu. So, I expect to know if there have H/W accelerate solution to use more CPU resource, to improve real-time performance? Thank you!

HarryBXie avatar Jan 22 '25 02:01 HarryBXie