data-driven-characters icon indicating copy to clipboard operation
data-driven-characters copied to clipboard
verified publisher icon mbchang

Maximum context length needs to be configurable

Open evangineer opened this issue 2 years ago • 1 comments

When generating characters using gpt-3.5-turbo instead of gpt-4, I get the following error:

openai.error.InvalidRequestError: This model's maximum context length is 4097 tokens. However, your messages resulted in 4215 tokens. Please reduce the length of the messages.

evangineer avatar Jul 01 '23 18:07 evangineer

After a lot of pain, I solved the problem by switching to gpt-3.5-turbo-16k.

Clearly relates to #5 and having to work around the hardcoding of GPT-4 in parts.

evangineer avatar Jul 01 '23 21:07 evangineer