openpose-editor
openpose-editor copied to clipboard
Addition of Text Editor for depth map (for crisp text generation)
Is your feature request related to a problem? Please describe. Text generation with stable diffusion is an issue with random letters an shapes appearing instead of clear words. Using ControlNet, if we add a "fake" depth map with our white text on black background, and an inpainting mask for the space we want the text to appear in (should be the same spot on the fake depth map), we can have crisp, clean text based on our prompt.
Describe the solution you'd like I saw that Fabric.js already has Text tools in its library, so maybe adding a small text editor (font size, font family dropdown) with the ability to drag and resize the text on the canvas to send it as a depth map to inpainting and controlnet, could allow us to have consistent text without the need of photoshop or other photo editors.
Additional context here is the technique of using depth maps for clear text: https://www.youtube.com/watch?v=1jBnGx72mpg also leaving this jsfiddle here as an example https://jsfiddle.net/gislef/Lvfpq57h/ But maybe all of this should be a separate project on github / tab on a1111