go-genai icon indicating copy to clipboard operation
go-genai copied to clipboard

Support for `multimodalembedding` image embeddings

Open ajroetker opened this issue 4 months ago • 0 comments

This library doesn't support the Vertex Google Model multimodalembedding functionality of creating embeddings from images and fails silently when you do pass image data to the model.

https://github.com/googleapis/go-genai/blob/main/transformer.go#L157 Should support the image data in the inlineData field as well as text instead of just text. Probably should support the gcsUri too since the model supports that.

Implementing manually works https://cloud.google.com/vertex-ai/generative-ai/docs/embeddings/get-multimodal-embeddings.

ajroetker avatar Aug 21 '25 17:08 ajroetker