llama_cpp_dart icon indicating copy to clipboard operation
llama_cpp_dart copied to clipboard
verified publisher icon netdur

Why does _processNextPrompt call _reset()? that destroys the context.

Open sgehrman opened this issue 5 months ago • 1 comments

why does _processNextPrompt call _reset()? that destroys the context. My second prompt had no info on the previous prompt and it didn't work.

sgehrman avatar Aug 14 '25 06:08 sgehrman

sorry, just design choice to have stateless library, context to be hold in history or using context cache

netdur avatar Aug 16 '25 18:08 netdur