mlx-audio icon indicating copy to clipboard operation
mlx-audio copied to clipboard

Whisper.cpp compatible /inference STT endpoint

Open kth8 opened this issue 8 months ago • 0 comments

I have many scripts that use whisper.cpp server POST /inference endpoint for transcription. All the mlx_audio.server endpoints available right now are for TTS. I would like to suggest adding a /inference or similar endpoint so STT models like the new Parakeet family added in mlx-audio v0.2.0 can be used remotely.

https://github.com/ggml-org/whisper.cpp/blob/master/examples/server/README.md

kth8 avatar May 16 '25 07:05 kth8