hf-chat
hf-chat copied to clipboard
Compilation to aarch64-apple-ios
Hey @Narsil, currently writing my own Tauri app to run a Candle model. However, I am running into the following compilation error when compiling to aarch64-apple-io:
error: instruction requires: fullfp16
--> /Users/santiagomedina/.cargo/registry/src/index.crates.io-6f17d22bba15001f/gemm-common-0.17.1/src/simd.rs:1982:18
|
1982 | "fmla {0:v}.8h, {1:v}.8h, {2:v}.h[0]",
| ^
|
note: instantiated into assembly here
--> <inline asm>:1:2
|
1 | fmla v0.8h, v1.8h, v2.h[0]
| ^
It seems that the issue is with the gemm crate (opened an issue here) but was just wondering if you bumped into this issue, and how you were able to go around it if you did. I see that you used a specific "metal6" candle branch. This branch does no longer seem to exist in the Candle repo.