FireRedASR icon indicating copy to clipboard operation
FireRedASR copied to clipboard
Published 3 months ago • verified publisher icon FireRedTeam

推理优化

Open Sedrick-Song opened this issue 9 months ago • 1 comments

请问除了代码中的fp16以及flash attention，还有什么加速LLM-based ASR推理的方法吗？谢谢！

Sedrick-Song avatar Mar 10 '25 07:03 Sedrick-Song

可以参考下：https://github.com/FireRedTeam/FireRedASR/pull/105

xsank avatar Nov 13 '25 07:11 xsank