ChatRWKV icon indicating copy to clipboard operation
ChatRWKV copied to clipboard
verified publisher icon BlinkDL

Stuck on "Run prompt..."

Open hellc opened this issue 3 years ago • 1 comments

Stuck on "Run prompt..." printed message after model init. What could be a problem? Using cpu fp32 settings

TY

hellc avatar Jan 24 '23 06:01 hellc

Use a very small model first

BlinkDL avatar Jan 24 '23 08:01 BlinkDL

UPDATE: the new ChatRWKV is much faster at processing the prompt

BlinkDL avatar Feb 05 '23 13:02 BlinkDL