WhisperKit icon indicating copy to clipboard operation
WhisperKit copied to clipboard

Published 20 hours ago • verified publisher icon argmaxinc

MLX performance improvement with in-place KVCache

Open atiorh opened this issue 5 months ago • 0 comments

#124 adds MLX support. We need to adopt the in-place KV cache update pattern to improve performance.

atiorh avatar Sep 10 '24 19:09 atiorh