private-chatbot-mpt30b-langchain icon indicating copy to clipboard operation
private-chatbot-mpt30b-langchain copied to clipboard

Published 20 hours ago • verified publisher icon mayooear

Testing in a macbook pro

Open alonsoir opened this issue 1 year ago • 2 comments

Thanks for sharing the model, I have been able to test it on my macbook pro, i9 with 32 GB of ram. I notice that the cpu goes to 400% when inferring the answer, and the gpu goes to 0%. Is it possible to make the model use the gpu? Radeon Pro Vega 20 4GB

alonsoir avatar Jul 01 '23 15:07 alonsoir