Toolio icon indicating copy to clipboard operation
Toolio copied to clipboard

AttributeError: 'ReusableKVCache' object has no attribute 'head_dim'

Open uogbuji opened this issue 1 year ago • 0 comments

This is due to an upstream change in mlx_lm. While investgating & fixing I also caught & applied based on this earlier patch.

Fixed in main. Will release Toolio 0.3.1 soon today.

cc @choccccy @olajiide

uogbuji avatar Jul 22 '24 21:07 uogbuji