cortex.cpp icon indicating copy to clipboard operation
cortex.cpp copied to clipboard

hardware: Windows on ARM support (with Snapdragon X series NPU)

Open high3eam opened this issue 1 year ago • 1 comments

  • [X] I have searched the existing issues

Is your feature request related to a problem? Please describe it

I was wondering if jan supports Windows on ARM platform, specifically on Snapdragon X series chips. Is it already planned to support this platform and potentially allow the use of the integrated NPU? It looks like closed source competitor "LMStudio" supports the platform already (BETA, and still without NPU support).

Describe the solution

Support for Windows on ARM and integrated NPU of Snapdragon X series chips.

Teachability, documentation, adoption, migration strategy

No response

What is the motivation / use case for changing the behavior?

Since Windows on ARM laptop are taking of with the newly released qualcomm ARM chips, it would be great if Jan natively supported it.

high3eam avatar Jul 18 '24 11:07 high3eam

We're working on supporting ONNX format models through DirectML, which natively accelerates on NPUs. There are some models available already, but consider this a work in progress https://cortex.so/models/

freelerobot avatar Sep 06 '24 07:09 freelerobot