Alpaca-LoRA-Serve icon indicating copy to clipboard operation
Alpaca-LoRA-Serve copied to clipboard

Published 20 hours ago • verified publisher icon deep-diver

I am running the 30b on colab premium plus. Inference via the gradio app is just going on for minutes without any response.Is that expected?

Open allthingssecurity opened this issue 1 year ago • 2 comments

I am running the 30b on colab premium plus. Inference via the gradio app is just going on for minutes without any response.Is that expected?

image

allthingssecurity avatar Mar 22 '23 15:03 allthingssecurity

Connection might not be stable. Have a look at the log (output of the running cell). It should spit something out when it receives something. Otherwise please refresh the session

deep-diver avatar Mar 22 '23 15:03 deep-diver

Sure. Thanks. Its not receiving anything.. I tried refreshing, but it remains same.

allthingssecurity avatar Mar 23 '23 00:03 allthingssecurity