localGPT icon indicating copy to clipboard operation
localGPT copied to clipboard

Published 20 hours ago • verified publisher icon PromtEngineer

load INSTRUCTOR_Transformer Terminated

Open yash-marathe opened this issue 2 years ago • 3 comments

$ python run_localGPT.py Running on: cuda load INSTRUCTOR_Transformer Terminated

This is the message when i run the instruction

yash-marathe avatar Jun 03 '23 11:06 yash-marathe

probably failing on gpu memory, try --device-type=cpu

gsm-masum avatar Jun 05 '23 07:06 gsm-masum

tried this: "--device-type=cpu", same thing!

ezzcodeezzlife avatar Jun 06 '23 12:06 ezzcodeezzlife

Can you monitor your ram? Probably failing on ram too. Had the same issue. Could not run on either cpu16gb or gpu 4gb

gsm-masum avatar Jun 06 '23 19:06 gsm-masum