Toolio icon indicating copy to clipboard operation
Toolio copied to clipboard
Published 1 month ago • verified publisher icon OoriData

MLX-provided enhancements: prompt caching and 4-bit KV quantization

Open uogbuji opened this issue 4 months ago • 2 comments

uogbuji avatar Sep 02 '25 18:09 uogbuji

Closes #38

uogbuji avatar Sep 02 '25 18:09 uogbuji

PR linking doesn't seem to work. Oh well.

uogbuji avatar Sep 02 '25 18:09 uogbuji