RAGatouille icon indicating copy to clipboard operation
RAGatouille copied to clipboard

Indexing on Mac: using 'mps' device?

Open fpservant opened this issue 1 year ago • 3 comments

Hi,

just installed RAGatouille on my mac and tried to create an index. It worked.

However, output shows several warnings:

UserWarning: torch.cuda.amp.GradScaler is enabled, but CUDA is not available. Disabling.

So does it use the Apple M2 chip, or the GPU? How to use the torch.device('mps') ?

TIA

fpservant avatar Jan 27 '24 14:01 fpservant

Hey, Currently, RAGatouille can only use cpu or cuda, as these are hard-coded upstream. There's active work (by @Anmol6) to remove the last few hurdles to being able to pass the device more freely and leverage mps on apple silicon, but it's not quite there yet!

bclavie avatar Jan 27 '24 14:01 bclavie

thanks

fpservant avatar Jan 27 '24 14:01 fpservant

Hey, Currently, RAGatouille can only use cpu or cuda, as these are hard-coded upstream. There's active work (by @Anmol6) to remove the last few hurdles to being able to pass the device more freely and leverage mps on apple silicon, but it's not quite there yet!

Thanks for the update. I'm looking forward to this.

matheusft avatar Jul 26 '24 13:07 matheusft