tiktoken icon indicating copy to clipboard operation
tiktoken copied to clipboard

gpt-3.5-turbo-instruct support

Open danny-avila opened this issue 2 years ago • 2 comments

for now, I'm using text-davinci-003 for model encoding, but not sure if that's right with this new model series

danny-avila avatar Sep 22 '23 10:09 danny-avila

I think it's the newer cl100k_base not the older model type

darknoon avatar Oct 15 '23 14:10 darknoon

I think it's the newer cl100k_base not the older model type

Which model would that be?

Is this right?

encodingForModel("gpt-3.5-turbo");

sam-goodwin avatar Oct 21 '23 04:10 sam-goodwin