Phi-3.5-MoE support

Open okaneyo opened this issue 1 year ago • 1 comments

Add support for this incredible model

Sep 03 '24 03:09 okaneyo

ChatMLX mainly relies on the support provided by MLX Swift Examples.

Add Phi 3.5 MoE https://github.com/ml-explore/mlx-swift-examples/pull/116

I will update promptly after this PR is merged.

Sep 03 '24 04:09 johnmai-dev

@okaneyo, you can test my attempt to implement Phi 3.5 MoE in https://github.com/ml-explore/mlx-swift-examples/pull/116 and tell me if it works. My MacBook unfortunately doesn't have enough RAM for me to test it myself.

Oct 19 '24 22:10 DePasqualeOrg

@okaneyo, you can test my attempt to implement Phi 3.5 MoE in ml-explore/mlx-swift-examples#116 and tell me if it works. My MacBook unfortunately doesn't have enough RAM for me to test it myself.

Thank you! @DePasqualeOrg

Nov 03 '24 06:11 johnmai-dev