cortex.cpp
cortex.cpp copied to clipboard
bug: weird responses from nitro when cache enabled
Describe the bug Nitro seems to be broken when enabled cache. It spams nonsense text after some time.
To Reproduce Steps to reproduce the behavior:
- Load model with
caching_enabled= true - Start conversation
- Nitro responses with some nonsense texts
Expected behavior Nitro responses nicely when cache enabled.
Can you attach current fixing branch to this issue
Fixing branch is: https://github.com/janhq/nitro/pull/508