luke
luke
Currently Candle supports Gemma 3 1B variant. the 4B variant needs something fixed. when i try to load it I get an error when loading the tokenizer. ``` retrieved the...
wow. this sounds amazing. we sure could use any speed boost we can get on metal. This original PR is from almost 5 months ago. Why is there no discussion...
@LaurentMazare would this help with inference speed of Metal for Flux and SD3 image generation?
just checking in again on this hanging PR. is there anyone out there that can review? do we need to do it different or fix something? thanks
this Would be great. And the F8 type is really helpful for other projects.
@LaurentMazare sorry to bug you but is there someone else we can ping to get this approved or at least some comment on why it's still sitting here for so...
it looks like the working branch is behind the main branch now. maybe the fp8 work should be pulled out. it looks like a lot of good work by @EricLBuehler
is that real?
maybe they should add some more admins that have merge authority. it seams like there are many people ready to work.
we are getting the same error. Tauri 2.0.2