Indexing on Mac: using 'mps' device?
Hi,
just installed RAGatouille on my mac and tried to create an index. It worked.
However, output shows several warnings:
UserWarning: torch.cuda.amp.GradScaler is enabled, but CUDA is not available. Disabling.
So does it use the Apple M2 chip, or the GPU? How to use the torch.device('mps') ?
TIA
Hey,
Currently, RAGatouille can only use cpu or cuda, as these are hard-coded upstream. There's active work (by @Anmol6) to remove the last few hurdles to being able to pass the device more freely and leverage mps on apple silicon, but it's not quite there yet!
thanks
Hey, Currently, RAGatouille can only use
cpuorcuda, as these are hard-coded upstream. There's active work (by @Anmol6) to remove the last few hurdles to being able to pass the device more freely and leveragempson apple silicon, but it's not quite there yet!
Thanks for the update. I'm looking forward to this.