candle
candle copied to clipboard
candle-flash-attn infinite compile time
When I added candle-flash-attn
to my .toml file the build process seems hang on Building [=======================> ] 114/118: candle-flash-attn(build)
and the compilation doesn't proceed.
My .toml file is
[package]
name = "occam"
version = "0.1.0"
edition = "2021"
[dependencies]
candle-core = { git = "https://github.com/huggingface/candle.git", version = "0.6", features = ["cuda"] }
candle-flash-attn = { git = "https://github.com/huggingface/candle.git", version = "0.6", features = [] }
candle-nn = { git = "https://github.com/huggingface/candle.git", version = "0.6", features = ["cuda"]}
serde = { version = "1.0", features = ["derive"] }
serde_json = "1.0"
glob = "0.3"
rand = "0.8"
anyhow = "1.0"