Alpaca-LoRA-Serve icon indicating copy to clipboard operation
Alpaca-LoRA-Serve copied to clipboard

Published 20 hours ago • verified publisher icon deep-diver

How to run it with llama-7b-hf-int4?

Open ZhUyU1997 opened this issue 1 year ago • 0 comments

I don't have enough GPU memory. Could you give the guide to run with INT4?

ZhUyU1997 avatar Mar 24 '23 17:03 ZhUyU1997