candle
candle copied to clipboard
huggingface
Minimalist ML framework for Rust
Hi all, forgive my ignorance but my understanding is that SDPA is cuda compatible but I can't find an implementation within candle_nn for it. I want to run some transformer...
Recently doing SNAC model to rust, the onnx can not be run due to Tile op. ``` Exploring on onnx model: snac_24hkz_sim.onnx ╭───────────────────────────── snac_24hkz_sim.onnx Summary ──────────────────────────────╮ │ IR Version: 7...
Hey, I'm super excited that this library is being built. I've been looking through the documentation and examples and I cannot see any examples of how to load a traced...
Using the stable-diffusion-3 example on a Mac with metal feature. When I run these lines ``` let vb_vae = vb.clone().rename_f(sd3_vae_vb_rename).pp("first_stage_model"); println!("vb_vae dtype {:?}", vb_vae.dtype()); let autoencoder = build_sd3_vae_autoencoder(vb_vae)?; println!("autoencoder {:?}",...
I’m encountering an issue while deploying the Stable Diffusion 3.5 Large Turbo model. The error occurs after about 67% of the model components are downloaded successfully, but it fails during...
FYI with current master I am getting: > ITMS-90755: Invalid Binary - The following binaries in your app contains prohibited instructions: (my binary with candle in it). Remove the instructions...
pipeline.run(&args.prompt, args.sample_len)?; if run twice, error will appear: ``` let mut pipe = TextGeneration::new( model, tokenizer, 1024, Some(0.67), Some(1.0), 1.1, 1, &device, ); pipe.run("who are you?", 235).unwrap(); pipe.run("how's your job?",...
When trying to share a tensor between multiple threads on a metal accelerator, I get this error and then the program aborts without a panic message. ``` -[AGXG14XFamilyCommandBuffer tryCoalescingPreviousComputeCommandEncoderWithConfig:nextEncoderClass:]:1015: failed...
On windows unable to use candle with cuda enabled. I'm using Cuda SDK 12.4 since that is what is supported by my pytorch install which runs fine. 🤔 Is Windows...
