shell_gpt icon indicating copy to clipboard operation
shell_gpt copied to clipboard

Published 20 hours ago • verified publisher icon TheR1D

choose model by argument

Open go-dockly opened this issue 1 year ago • 7 comments

It would be useful to have a -m (--model 'gpt-4') argument for sgpt

https://platform.openai.com/docs/models/gpt-4

go-dockly avatar Mar 14 '23 22:03 go-dockly

Currently GPT-4 is not available thru API, when OpenAI will allow to use it via API, it will be implemented.

TheR1D avatar Mar 14 '23 22:03 TheR1D

is there a possibility to specify a model by cmd arg? could this be added?

go-dockly avatar Mar 14 '23 23:03 go-dockly

Currently sgpt uses /chat API endpoint, which has only two available model options (except coming GPT-4): gpt-3.5-turbo - used by sgpt and gpt-3.5-turbo-0301. I think there is no reason to use gpt-3.5-turbo-0301 with sgpt. Imho it doens't make sense to have --model option for now, but once GPT-4 will be available over API, it will be implemented.

TheR1D avatar Mar 14 '23 23:03 TheR1D

coming gpt 4 it has this option gpt-4-32k (Same capabilities as the base gpt-4 mode but with 4x the context length) so eventually it would be nice to differentiate between those but you are absolutely right it doesn't make sense to differentiate between -0301 versions.

go-dockly avatar Mar 15 '23 00:03 go-dockly

Just commenting to say that I got into the GPT-4 on API preview — I can imagine that it's rolling out now to a lot of people soon.

mdonaberger avatar Mar 17 '23 22:03 mdonaberger

I have just realized this does have the follow on issue of chats don't keep track of what model they were conducted with. I will have to see how this interacts.

lpurdy01 avatar Mar 23 '23 06:03 lpurdy01

Nvm. It seems to work fine switching models with the same chat_id

lpurdy01 avatar Mar 23 '23 07:03 lpurdy01