arcadia icon indicating copy to clipboard operation
arcadia copied to clipboard

Able to chat images with multimodal apis/models

Open bjwswang opened this issue 5 months ago • 0 comments

  1. user uploads a imiage, call a multimodal service(qwen-vl) to identify it (maybe with documentloader) and embedding the description message to vectorstore with extra image info.
  2. Based on user's question in chat, we should return a special image reference

bjwswang avatar Feb 29 '24 08:02 bjwswang