mlx-swift icon indicating copy to clipboard operation
mlx-swift copied to clipboard

Published 20 hours ago • verified publisher icon ml-explore

Add SuScaledRotaryEmbedding

Open DePasqualeOrg opened this issue 6 months ago • 2 comments

I've ported this from the Python implementation: https://github.com/ml-explore/mlx-examples/blob/main/llms/mlx_lm/models/su_rope.py

This is needed for the new Phi 3.5 models. I still need to update mlx-swift-examples analogous to this PR in mlx-examples and test this.

DePasqualeOrg avatar Aug 20 '24 22:08 DePasqualeOrg