openplayground icon indicating copy to clipboard operation
openplayground copied to clipboard

Help .. increase gpt4 model maximum tokens more than 8192 PLEASE

Open khanfar opened this issue 1 year ago • 5 comments

Help .. increase gpt4 model maximum tokens more than 8192 PLEASE in https://nat.dev/ website . need more than 8192 please ... if can make it 16000

khanfar avatar Apr 19 '23 00:04 khanfar

i need more than 8192 and i put long code to edit in nat,dev . the 8192 tokens is not enough for me , please make it twice like 16000 .

khanfar avatar Apr 19 '23 06:04 khanfar

20230419_172624.jpg

I ask long question and need answer to modify mo python code , the answer is stop and I get this message. Please I pay without get full answer my question in coding , please increase memory side of nat.dev or increase the gpt4 tokens Maximum length. So we can use

khanfar avatar Apr 19 '23 14:04 khanfar

When using the API, the gpt-4 model has a limit of 8192 tokens, while gpt-3.5-turbo has a limit of 4096. Those are limited by the model itself, this project can do little about it. It is said that there is a gpt-4-32k model which supports up to 32768 tokens, and that would be around 50000 words. If you have access to it, you can try it as an alternative.

Zhwt avatar Apr 21 '23 03:04 Zhwt

ok let me access it .. this is my email in nat.dev : [email protected]

khanfar avatar Apr 21 '23 17:04 khanfar

When using the API, the gpt-4 model has a limit of 8192 tokens, while gpt-3.5-turbo has a limit of 4096. Those are limited by the model itself, this project can do little about it. It is said that there is a gpt-4-32k model which supports up to 32768 tokens, and that would be around 50000 words. If you have access to it, you can try it as an alternative.

I'm a total newb, how do I access this?

ralyodio avatar Apr 23 '23 06:04 ralyodio