canopy
canopy copied to clipboard
[Feature] Support for new OpenAI multimodality
Is this your first time submitting a feature request?
- [X] I have searched the existing issues, and I could not find an existing issue for this feature
- [ ] I am requesting a straightforward extension of existing functionality
Describe the feature
Enabled Canopy to also allow uploading for images, or indexing of images, for the RAG operation. This also means that inference API from Canopy should be able to respond with a proper REST format (JSON + base64 enc for bin?) to return said produced images.
Describe alternatives you've considered
Considering creating something like this myself.
Who will this benefit?
Multimodal RAG users who wish to use multimodality within the ChatCompletions API from OpenAI , for example.
Are you interested in contributing this feature?
yes, but I've just discovered canopy 10 minutes ago :)
Anything else?
No response