jupyter-ai icon indicating copy to clipboard operation
jupyter-ai copied to clipboard

image recognition API support

Open simonff opened this issue 1 year ago • 0 comments
trafficstars

Problem

I work on the Google Earth Engine team. Our product often returns map tiles as analysis outputs, and it might be helpful to immediately send them to an an image recognition API to get a quick feel for the result.

Proposed Solution

I can always hardcode an API call to do that, but it would be nice if Jupyter had a built-in option to get a "running commentary" on image output. LLMs already can make sense of text output of the code they generate, but understanding image output would be very powerful.

simonff avatar Jan 29 '24 03:01 simonff