go-openai icon indicating copy to clipboard operation
go-openai copied to clipboard

support gpt-4-vision-preview model

Open sotowang opened this issue 1 year ago • 7 comments

Please provide support for the gpt-4-vision-preview model. The ChatCompletionMessage is currently not useful for gpt-4-vision-preview.

sotowang avatar Nov 18 '23 04:11 sotowang

+1

xiaoyi510 avatar Nov 18 '23 08:11 xiaoyi510

Duplicates #539 Awaiting PR: #580

rkintzi avatar Nov 18 '23 14:11 rkintzi

+1

WhiteNightMo avatar Nov 22 '23 07:11 WhiteNightMo

yeapp, looking forward for vision support as well!

NicksonYap avatar Dec 02 '23 21:12 NicksonYap

When will the new version be released?

anhao avatar Dec 08 '23 03:12 anhao

@anhao it seems to have been merged https://github.com/sashabaranov/go-openai/pull/580

but no docs yet

NicksonYap avatar Dec 08 '23 04:12 NicksonYap

Not sure if people have updated the docs, but here is a simple working example uploading a base64 image to the vision API!

		Model:     openai.GPT4VisionPreview,
		MaxTokens: 1000,
		Messages: []openai.ChatCompletionMessage{
			{
				Role: openai.ChatMessageRoleUser,
				MultiContent: []openai.ChatMessagePart{
					{
						Type: openai.ChatMessagePartTypeText,
						Text: "What's in this image?",
					},
					{
						Type: openai.ChatMessagePartTypeImageURL,
						ImageURL: &openai.ChatMessageImageURL{
							URL:    fmt.Sprintf("data:image/jpg;base64,%s", imgString),
							Detail: openai.ImageURLDetailLow,
						},
					},
				},
			},
		},
	})```

yashrao99 avatar Jan 27 '24 19:01 yashrao99