cortex.cpp

cortex.cpp copied to clipboard

Problem A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Success Criteria A clear and concise description of what you want to happen.

Additional context Add any other context or screenshots about the feature request here. related: #1103

Very important engine, especially with the ever growing offerings from Apple coming out…

Would that be of any help the LM Studio has implemented MLX.

Once #2010 lands, MLX backend can be implemented in a similar manner. MLX has an official OpenAI-compatible server https://github.com/ml-explore/mlx-lm/blob/main/mlx_lm/SERVER.md