cody icon indicating copy to clipboard operation
cody copied to clipboard

Chat: add vision support, upload images

Open olafurpg opened this issue 1 year ago • 1 comments

Demo https://www.loom.com/share/638240e061cd449ab4fd2ac30b6ec356

Previously, it was only possible to send text to Cody via Chat. This PR adds new support to additionally send Cody images. This can be helpful, for example, when you want to write a basic HTML structure based on a Figma design.

Based on the changes in https://github.com/sourcegraph/cody/pull/4694/files#diff-93ab3b057cf286b165b92ef5a20dd588f286bf3d93ee78e72d63c4696904a006 In this PR, the image goes to Sourcegraph backend and works with both Anthropic and OpenAI models. The other PR only worked with the local llava model via Ollama.

Accompanying backend PR https://github.com/sourcegraph/sourcegraph/pull/546

Test plan

TBD

Changelog

olafurpg avatar Sep 20 '24 14:09 olafurpg