Martin Zirulnik

> completely agree it can be useful to have a system message in the prompt, but thats more the role of the prompt itself rather than the chat history yes...

> What you need is overwrite the StreamingStdOutCallbackHandler's 'on_llm_new_token' method, as I realized that the method only print the token in stream, but do nothing to the output. So I...

> > What you need is overwrite the StreamingStdOutCallbackHandler's 'on_llm_new_token' method, as I realized that the method only print the token in stream, but do nothing to the output. So...