vercel
The attachment url is not passed to the LLM
Description
I followed the multimodal guide and noticed that the LLM doesn’t seem to receive attachment metadata, only the raw file data.
My use case is that I have an image editing tool using the gpt-image-1 model, which takes a list of image URLs. When I add attachments using Attachment[], I expected the LLM to get the URL information from the list and use it with the tool. It seems that this info isn’t passed to the LLM call.
As a workaround, I’m calling a processMessages function before invoking the LLM. It extracts the attachment info and includes it as extra text part in the user message.
Is there a better way to include additional metadata in the current message? prepareRequestBody doesn’t quite work for this since it’s not tied to a specific message and doesn’t persist across calls.
