alpaca-electron icon indicating copy to clipboard operation
alpaca-electron copied to clipboard
verified publisher icon ItsPi3141

When clear chat is pressed two times, subsequent requests don't generate anything

Open VictorZakharov opened this issue 2 years ago • 1 comments

Describe the bug When clear chat is pressed two times, subsequent requests don't generate anything.

To Reproduce Steps to reproduce the behavior:

  1. Ask something. Wait for bot to answer. Observe CPU is around 70%. I have a Ryzen 9 5900x.
  2. Press clear chat twice.
  3. Ask something else.
  4. Nothing happens, CPU is idle.

Expected behavior Should be able to continue in a new conversation without having to end process in Task Manager every time.

Screenshots N/A

Desktop (please complete the following information):

  • OS: Windows 10.
  • Browser: Chrome.
  • Version: 112

Additional context Using Alpaca 13B native model linked from the Releases page. I tried the above workflow two times with the same problem before posting this issue.

VictorZakharov avatar Apr 10 '23 20:04 VictorZakharov

Yes that's a known issue with llama.cpp itself. I will try to implement a temporary fix for it soon.

ItsPi3141 avatar Apr 10 '23 20:04 ItsPi3141