inference icon indicating copy to clipboard operation
inference copied to clipboard

Regarding the support for the MLX UI interface issue

Open okwinds opened this issue 1 year ago • 4 comments

Xinference has already supported the inference of MLX format models in the previous version ( 0.13.1 ).

After I registered a downloaded MLX model and tried to launch it from the custom UI interface, I couldn't find the MLX model engine. I hope the next version will support it on the UI.

0.13.2 image

okwinds avatar Jul 12 '24 13:07 okwinds

Registering MLX custom model is not supported yet, we will support it ASAP.

qinxuye avatar Jul 14 '24 12:07 qinxuye

This issue is stale because it has been open for 7 days with no activity.

github-actions[bot] avatar Jul 21 '24 19:07 github-actions[bot]

This issue is stale because it has been open for 7 days with no activity.

github-actions[bot] avatar Aug 06 '24 06:08 github-actions[bot]

This feature is already supported and can be closed

okwinds avatar Aug 10 '24 14:08 okwinds