candle
candle copied to clipboard
huggingface
Minimalist ML framework for Rust
@LaurentMazare How can I use candle for a cross-encoder from sentence-transformers models (msmarco models: e.g. msmarco-distilroberta-base-v3)? Does it require differents stack of implementation or can I just use the Bert...
I am mostly interested in candle for its powerful autograd feature and its applications in scientific computing. But reading from #1241, it appears that using the autograd to access intermediate...
Hello. I mentioned this in the discord and worked with a member to make sure I wasn't doing anything dumb. I tested the release version of my candle code with...
I add the 'cl.exe' to PATH, but still says can not found. ``` error: failed to run custom build command for `candle-kernels v0.5.1 (https://github.com/huggingface/candle.git#cd4d941e)` Caused by: process didn't exit successfully:...
The Phi 3.5 MoE model is a ~42B parameter model with 16 experts, using 2 active. This PR implements the model and provides a simple inference example. Additionally, this PR...
In Python it's possible to write just this: `3 * x**2 - 4*x + 5` With Candle it currently looks like this, which is difficult to read and write: `Ok((&(&(&x.powf(2.0)?...
``` C:\Users\igumn\candle\candle-examples\examples\quantized>cargo run --features=cuda --example quantized --release -- --model=gemma-2-2b-it.q4_k_m.gguf --prompt "def fibonacci(n): " Finished `release` profile [optimized] target(s) in 0.48s Running `C:\Users\igumn\candle\target\release\examples\quantized.exe --model=gemma-2-2b-it.q4_k_m.gguf --prompt "def fibonacci(n): "` avx: true, neon:...
Hi, Will candle support rust polars dataframe in the future ?
I have this problem and want to ask but can't find hf of candle, where can I solve it
