Nicolas Patry

Results 978 comments of Nicolas Patry

No this will not get merged as it would be only available for MacOS, but by all means check out the branch and try it out !

> though i think this can't be used with tauri on cross-platform apps anyway.. i'll try to think of a different solution Why cannot it be ? Tauri is just...

Not with Tauri, and it's been a long time since I used the electron app tbh. The main issue was being on the main thread (which is required by MacOS)....

Ohh I have NO idea how WSL handles it's graphics part, but since you're on windows you should probably use the windows code which should work. The code on WSL...

Did you authorize Terminal ? `needs to have accessibility settings enabled (Terminal added in System Preferences > Security & Privacy > Privacy > Accessibility).` Grab is not 100% supported as...

Oh ! Nice catch. Sorry for the late reply, for some reason I wasn't notified of issues in my own repo ??? Any ideas on how to fix this ?...

What do you mean it doesn't work ? Are the keys not sent, or doesn't it do what it should ? There might be something within the app you're trying...

Not really safetensors limitation in the format, more about internals of torch limiting mmaping. More info here if you want to bypass those limitations. https://github.com/huggingface/safetensors/issues/373#issuecomment-1829513862

Here are are mine. I tried fiddling around with cache sizes but as suspected it didn't yield anything significant. ![F16](https://github.com/philipturner/metal-flash-attention/assets/204321/471325e6-e4d6-46ed-b1e0-eb97bd91099e) ![float32](https://github.com/philipturner/metal-flash-attention/assets/204321/79328834-4a1c-4507-a8e8-a3418748d865) One surpising thing to me, was that reducing the...