Awesome AI image synthesis

A list of awesome tools, ideas, prompt engineering tools, colabs, models, and helpers for the prompt designer playing with aiArt and image synthesis. Covers Dalle2, MidJourney, StableDiffusion, and open source tools. Many of these tools come with "batteries included" and won't include colabs or python code you have to run. (for colabs see this list)

Contents

• 🤖 Text-to-image Models

  • 💰 Commercial
  • ☁️ Free hosted
  • 💻 Free local - Run on your GPU

• Prompt engineering

  • 🎨 Tools for prompt engineer
  • 📚 Artist studies
  • 🔗 Browser extensions
  • 🎩 Tips and tricks
  • 🎭 Inspiration tools

• ✨ Post processing tools

  • 💰 Resolution upscale - hosted
  • 🆓 Resolution upscale - free
  • 🙃 Fix faces
  • ✋ Fix hands
  • 👸 Beutify
  • 👩‍🌾 Outcrop
  • 👩‍🎨 Inpaint

• 👨‍👨‍👧‍👦 Communities

• 👩‍🏫 Theory & Learning

  • 🐦 Twitter Threads
  • 🎥 Videos
  • ✉️ Substack newsletters
  • 🫡 Notable twitter follows

• [🚨 Upcoming exciting projects](#upcoming-exciting-projects]

Text-to-image Models you can run

Models, commercial and open source, that you can either try for free and pay for credits or can run in the cloud.

Commercial

• DreamStudio - #StableDiffusion in the cloud
• Midjourney - Discord bot with amazing visuals
• Dalle2 - The one that started it all, great with multi characters
• NightCafe - Nightcafe studio is an AI Art Generator (incrorporates stableDiffusion)
• ArtBreeder Collage - A collaging tool to generate art using visual aides.

Free hosted tools

• Craiyon - Formerly dalleMini - open source tool that outputs great compositions but lower quality
• StableDiffusion on HuggingFace - Run the #StableDiffusion right in huggingface UI
• StableDiffusion on Replicate - Run #StableDiffusionon on replicate.com
• Google Colab - Google free GPU machines in the cloud running models of all sorts.

Free local

*Advanced Batteries not included, this section is for advanced folks who can use the command line, install python packages, run code etc'

• StableDiffusion + Web GUI - This repo has a step by step way to install and run #stableDiffusion using local GPU + a gradio based web UI. Has a nice UI, upscalers built-in, img2img and inpainting, and a LOT more! (see thread with features

• StableDiffusion with Diffusers - A simple-ish way to run stable diffusion locally using hugging face diffusers library

img2img - Generate images from a combination of prompt + init image

img2img refers to the practice of feeding a model an init image AND a prompt.

• stable-img-to-img - Hosted version of img2img tool from stable diffusion. Provide an image + a prompt

Prompt engineering

The emerging field of the Prompt Engineering is just beginning, and yet there are tools released for us every day. Follow this repo for the best tools as they become "Awesome"

Tools for prompt engineers

• Lexica - A prompts search engine
• Krea.ai - A prompt builder with a nice UI, searchable prompts.
• PromptMania prompt builder - A prompt builder that supports MJ, SD and Dalle, with visual examples and a lot of modifiers
• Promptbase Marketplace - Buy and sell your promtps for 💰
• GPT-2 prompt generator - A GPT2 model trained to autocomplete MJ prompts

Artist/Modifier studies

• Stable diffusion artist study - A huge list of artist (no living) with examples by (@sureailabs, @proximasan, @EErratica, and @KyrickYoung)
• StableDiffusion modifier study - A great study of modifiers that can enhance your prompts significantly
• Google doc with 3800+ artists and styles - Great collaborative effort 3800+ artists and styles + tips for prompting. Continuesly updated. (without generated images)

Browser extensions

• Dalle prompt helper - a chrome extension to inject prompts into the Dalle interface by @altryne

Tips and tricks

• CLIP interrogator - Convert uploaded images into prompts by @pharampsychotic
• img2prompt - Hosted version of CLIP interrogator on Replicate. Upload image, get prompt ideas.

Inspiration tools

• same.energy - A visual exploration search engine.
• CLIP retrieval - Allows you to browse the major datasets the img-2-text models were trained on.

Post processing tools

Resolution upscale - subscription

• Gigapixel upscaler Great upscaler app + web. One time payment
• https://letsenhance.io/ - LetEnhance is a credit based enhancement system

Resolution upscale - free

• WebUI repo has upscalers built in!
• real-esrgan - A hosted version of real-ERSGan with optional face correction
• Cupscale - Windows app that upscales with ERSGan on your GPU

Fix faces

• [

Fix hands

Beutify

• TBD

Outcrop

• TBD

Inpaint

• TBD

Communities

• StableDiffusion discord - A great community with folks who help each other
• MidJourney - A huge community of image synthesis folks, prompt help, inspiration channels etc'

Theory & Learning

Tutorials

• A-Traveler-s-Guide-to-the-Latent-Space - In depth guide for prompt engineering.
• Dalle2 prompt book - A great, visual intro to prompt creation by @guyp - Dalle focused

Twitter Threads

• Dalle vs MJ vs StableDiffusion - A great thread comparing the 3 main models by @fabianstelzer
• Stable Diffusion explained - A easy to udnerstand stable diffusion explanation thread by @ai__pub

Notable twitter follows

• Ai, AiArt, Generative - A twitter list of 70+ #aiArt community members, a stream of conciuosness for the field
• @ClaireSilver12 - Great content, tips and tricks, up to date knowledge about ai synthesis
• @TomLikesRobots - Deep insight into this new tech, with updates
• @diffusionBot - A stableDiffusion bot that generates a prompt right in twitter replies when you mention it.
• Whats AI - Louis Bouchard - Accessible AI concepts, paper reviews, youtube videos

Upcoming exciting projects

🚨 These are some of amazing things folks are working on, and is worth keeping in mind, maybe register to their waiting list or give them a follow

• Alpaca - Photoshop plugin - Exciting photoshop implementation! DEMO
• Ando - figma plugin - Figma plugin! DEMO
• Stablender - a blender plugin - a WIP blender plugin with SD

If you find this list valuable

Contribute

Contributions more than welcome! In fact it's why I wrote this list, to get contributions and have folks subscribe to changes to get notified about new and exciting stuff coming to this world of AI art

Read the contribution guidelines first.

Acknowledgements and shoutouts

@pharampsychotic - For the insane tools list on their website, the support in DMs, and the spaces with a lot of patience and answers ❤️