Awni Hannun
Awni Hannun
Yea I don't know if the Rosetta thing in terminal actually matters, I'm having doubts about that now But I spot your problem: ``` -- Building MLX for x86_64 processor...
Can you share the output of `clang -v` and `g++ -v` ?
Lol what is going on !!!
I have to read more about what triggers this flag `CMAKE_HOST_SYSTEM_PROCESSOR` as we clearly do not understand it well enough. Clearly it thinks you are building for x86 but all...
> On macOS, the value of uname -m is used by default. However, since this might vary based on whether you're using x86 or ARM CMake, version 3.19.2+ will use...
Can you try compiling with: ``` env CMAKE_APPLE_SILICON_PROCESSOR=arm64 /opt/homebrew/bin/cmake .. make -j ```
Could you try running with `make VERBOSE=1` just to see the actual compile commands. It will spit out a bunch of stuff, but just one of them would be interesting...
Wow, the age old solution "restart" actually worked here. I'm dumbfounded, but glad it's fixed.
Yes that's a known limitation of our [quantization](https://ml-explore.github.io/mlx/build/html/python/_autosummary/mlx.core.quantize.html) at the moment. Will mark this as an ehnancment. In the meantime one thing you could do as a workaround so you...
Yes so there are two projections, one for the keys and one for the values. ``` k = x @ Wk.T v = x @ Wv.T ``` Instead you could...