canopy icon indicating copy to clipboard operation
canopy copied to clipboard

[Feature] Support for new OpenAI multimodality

Open sivang opened this issue 1 year ago • 4 comments

Is this your first time submitting a feature request?

  • [X] I have searched the existing issues, and I could not find an existing issue for this feature
  • [ ] I am requesting a straightforward extension of existing functionality

Describe the feature

Enabled Canopy to also allow uploading for images, or indexing of images, for the RAG operation. This also means that inference API from Canopy should be able to respond with a proper REST format (JSON + base64 enc for bin?) to return said produced images.

Describe alternatives you've considered

Considering creating something like this myself.

Who will this benefit?

Multimodal RAG users who wish to use multimodality within the ChatCompletions API from OpenAI , for example.

Are you interested in contributing this feature?

yes, but I've just discovered canopy 10 minutes ago :)

Anything else?

No response

sivang avatar Nov 09 '23 10:11 sivang