nm-vllm icon indicating copy to clipboard operation
nm-vllm copied to clipboard

[WIP] afeldman-nm/encoder decoder

Open afeldman-nm opened this issue 1 year ago • 0 comments

GOALS • Whisper support • Exemplifies encoder/decoder (E/D) support • E/D K/V caching • E/D parallelism

TESTING • HuggingFace whisper model • Replicate public English Speech Recognition (SR) test using canned audio • Audio front-end is out-of-scope of this PR

afeldman-nm avatar Feb 16 '24 19:02 afeldman-nm