cortex.cpp icon indicating copy to clipboard operation
cortex.cpp copied to clipboard

bug: weird responses from nitro when cache enabled

Open vansangpfiev opened this issue 1 year ago • 2 comments

Describe the bug Nitro seems to be broken when enabled cache. It spams nonsense text after some time.

To Reproduce Steps to reproduce the behavior:

  1. Load model with caching_enabled = true
  2. Start conversation
  3. Nitro responses with some nonsense texts

Expected behavior Nitro responses nicely when cache enabled.

vansangpfiev avatar Apr 19 '24 00:04 vansangpfiev

Can you attach current fixing branch to this issue

tikikun avatar Apr 22 '24 02:04 tikikun

Fixing branch is: https://github.com/janhq/nitro/pull/508

vansangpfiev avatar Apr 22 '24 02:04 vansangpfiev