gpt2-tokenizer-java icon indicating copy to clipboard operation
gpt2-tokenizer-java copied to clipboard

Published 20 hours ago • verified publisher icon hyunwoongko

Question: Is this lib still valid for gpt-3.5-turbo ?

Open jiangying000 opened this issue 1 year ago • 2 comments

jiangying000 avatar Mar 07 '23 13:03 jiangying000

no.. gpt3.5 use cl100k_base but it was r50k_base now.

meamde avatar Mar 16 '23 01:03 meamde

Is there a plan to support the adaptation of GPT-3.5 Turbo and GPT-4 models?

Lambdua avatar Apr 14 '23 06:04 Lambdua