candle
candle copied to clipboard
huggingface
Minimalist ML framework for Rust
Earlier, it was not possible to use a Clip model by providing a model ID and revision because the ClipConfig was not loaded from the config.json file. I made the...
MetaVoice?
MetaVoice seems amazing as a TTS allowing any voice model 1 shot training instantly (sounds too good to be true). https://github.com/metavoiceio/metavoice-src/issues/1 It has some issues with MPS of course and...
Hello, I think candle is very interesting. I am looking for a minimal example of a chatbot. Is there any? A monthly blog would be great. So it would be...
Hi, I need some help with translating things written in Python: f.e. I have such a statement: ``` import torch.nn.functional as F result[mask] = result[mask] + F.interpolate(cur_result.permute(3,0,1,2).unsqueeze(0).contiguous(), (H, W, D),...
Hi, The candle-kernel crate throws an error on the Maxwell architecture when migrating code that works fine in PyTorch. It seems the only problem is '__dp4a' which used for performing...
Hi, how should I translate this expression from Python(torch) to candle: Both count, mask and result are tensors: ``` mask = (count.squeeze(-1) > 0) result[mask] = result[mask] / count[mask].repeat(1, C)...
I'm running into an issue where the first time I call `apply_repeat_penalty`, it takes a very long time (in excess of 6 seconds). It seems to be coming from the...
Hi, I'm trying to pass a chat dialog in the [LLama3 format](https://github.com/meta-llama/llama3/blob/main/llama/tokenizer.py#L222) to the [llama example](https://github.com/huggingface/candle/tree/main/candle-examples/examples/llama) via -prompt, the string is as follows: ``` system You are a helpful AI...
I'm running candle with metal acceleration on iOS via uniffi, specifically: ``` candle-core = { version = "0.6.0", features = ["metal"] } candle-nn = { version = "0.6.0", features =...
Given that the description of Candle mentions that the focus is performance (and ease of use), I think it's important that we build and document benchmarks and comparisons with other...
