stop should either be excluded, set to [] or utilized. Setting it to null caused errors

[foxbg]

In the prompt stop is set to null. stop should either be excluded, set to [] or utilized.

{"messages": [{"role": "system", "content": "ChatDev is a software company powered by multiple intelligent agents, such as chief executive officer, chief human resources officer, chief product officer, chief technology officer, etc, with a multi-agent organizational structure and the mission of 'changing the digital world through programming'.\n......"}, {"role": "user", "content": "ChatDev ..."}], "model": "gpt-3.5-turbo-16k", "frequency_penalty": 0.0, "logit_bias": {}, "max_tokens": 15821, "n": 1, "presence_penalty": 0.0, "stop": null, "stream": false, "temperature": 0.2, "top_p": 1.0, "user": ""}HTTP/1.0 200 OK

Ref: https://github.com/LostRuins/koboldcpp/issues/643

[LostRuins]

Also "max_tokens": 15821 is not a good idea. It should ideally be half or less of your maximum context length, 1k is a good value.

[thinkwee]

Could you please try the latest version of ChatDev and provide more background information? I don't know the relationship between ChatDev and koboldcpp.