jan
jan copied to clipboard
bug: nightly-372 Regenerated answers are contaminated with thread title summary prompt
Regenerating answers leads to strange output
Using Mistral 7B Instruct v0.2 Q5_K_M with chat prompt [INST] {prompt} [/INST]
running on Vulkan acceleration.
sus: latest nitro cache issue & gibberish response. Investigating
I can no longer reproduce this in nightly Jan v0.4.11-386