Alpaca-LoRA-Serve icon indicating copy to clipboard operation
Alpaca-LoRA-Serve copied to clipboard

Published 20 hours ago • verified publisher icon deep-diver

Enable MPS inference for Apple silicon

Open mglev1n opened this issue 1 year ago • 0 comments

Could MPS support be added to enable faster inference using Apple silicon? See https://github.com/tloen/alpaca-lora/pull/48 for an example implementation using the original 7B Alpaca-LoRA checkpoint.

mglev1n avatar Mar 18 '23 18:03 mglev1n