candle icon indicating copy to clipboard operation
candle copied to clipboard

Support for Nvidia unified memory?

Open jac-cbi opened this issue 1 year ago • 1 comments
trafficstars

All,

I saw this morning that Tim Dettmers bitsandbytes python lib uses Nvidia's Unified Memory by default, see (csrc/pythonInterface.c:377).

It doesn't look like candle, via cudarc supports this.

I'm interested in supporting this feature in Rust because my current GPU has a decent compute score, but only 4GB of VRAM (T1000).

Is there any plan to support this in candle?

jac-cbi avatar Jan 24 '24 18:01 jac-cbi

+1 For unified memory, would be a great feature

jamesdborin avatar Apr 02 '24 18:04 jamesdborin