cookbook icon indicating copy to clipboard operation
cookbook copied to clipboard

Sketch2Paint - A web app demo that converts sketches into beautiful paintings

Open NSTiwari opened this issue 8 months ago • 4 comments

Description of the feature request:

Hi @Giom-V, @markmcd.

I've developed a fun web application that allows you to convert your hand-drawn sketches into creative paintings using Gemini Flash 2.0 Image Generation model.

Some results:

Example 1: Image

Example 2: Image

Here's my original GitHub repository for this project: This isn't a standard .ipynb notebook file, so I would love to know if this can be contributed to the cookbook as an example.

What problem are you trying to solve with this feature?

No response

Any other information you'd like to share?

No response

NSTiwari avatar May 05 '25 08:05 NSTiwari

That's a really cool idea, thanks for sharing this! @NSTiwari

william-Dic avatar May 05 '25 10:05 william-Dic

Sorry @NSTiwari I thought I has answered you already. I think it's a cool demo but I'm kinda against multi-files demos in the cookbook as it's more complicated to try right away. My usual recommendation is to keep it in a dedicated project (which is what we do for google-owned demos like the live-api-console.

I think that demo could also be a nice Applet in AI Studio. I'm not sure if there's yet a way to make to discoverable publicly but that should land at some point.

I'm thinking of adding a "cool community projects" list in the example readme. What do you think about that idea?

Giom-V avatar May 09 '25 16:05 Giom-V

Sorry @NSTiwari I thought I has answered you already. I think it's a cool demo but I'm kinda against multi-files demos in the cookbook as it's more complicated to try right away. My usual recommendation is to keep it in a dedicated project (which is what we do for google-owned demos like the live-api-console.

I think that demo could also be a nice Applet in AI Studio. I'm not sure if there's yet a way to make to discoverable publicly but that should land at some point.

I'm thinking of adding a "cool community projects" list in the example readme. What do you think about that idea?

That's a really good idea, @Giom-V. Just in case if you're not aware, here's how the Gemma team is maintaining their cookbook: They have a separate Demo section altogether that includes web app, mobile apps using Gemma models, and I've contributed to several of them like:

  1. Gemma on Android
  2. PaliGemma on Android
  3. PaliGemma 2 on the browser using ONNX and Transformers.js

Not sure if the same idea can also be implemented by the Gemini team. Open to your thoughts.

NSTiwari avatar May 09 '25 16:05 NSTiwari

Hello again, @Giom-V. I've just created a notebook version of my web application, so, everything can be done in a Jupyter/Colab notebook now.

PR #790 is created for the same. Could you please review?

NSTiwari avatar Jun 01 '25 03:06 NSTiwari