RAGatouille
RAGatouille copied to clipboard
Indexing on Mac: using 'mps' device?
Hi,
just installed RAGatouille on my mac and tried to create an index. It worked.
However, output shows several warnings:
UserWarning: torch.cuda.amp.GradScaler is enabled, but CUDA is not available. Disabling.
So does it use the Apple M2 chip, or the GPU? How to use the torch.device('mps') ?
TIA
Hey,
Currently, RAGatouille can only use cpu
or cuda
, as these are hard-coded upstream. There's active work (by @Anmol6) to remove the last few hurdles to being able to pass the device more freely and leverage mps
on apple silicon, but it's not quite there yet!
thanks
Hey, Currently, RAGatouille can only use
cpu
orcuda
, as these are hard-coded upstream. There's active work (by @Anmol6) to remove the last few hurdles to being able to pass the device more freely and leveragemps
on apple silicon, but it's not quite there yet!
Thanks for the update. I'm looking forward to this.