candle
candle copied to clipboard
Support for Nvidia unified memory?
trafficstars
All,
I saw this morning that Tim Dettmers bitsandbytes python lib uses Nvidia's Unified Memory by default, see (csrc/pythonInterface.c:377).
It doesn't look like candle, via cudarc supports this.
I'm interested in supporting this feature in Rust because my current GPU has a decent compute score, but only 4GB of VRAM (T1000).
Is there any plan to support this in candle?
+1 For unified memory, would be a great feature