SUPIR icon indicating copy to clipboard operation
SUPIR copied to clipboard

Full Tutorial + 1 Click 12 GB VRAM Installer + Batch Upscale + Comparison With Magnific - SUPIR Starts A New Era

Open FurkanGozukara opened this issue 11 months ago • 15 comments

I have dedicated several days, working over 12 hours each day, on SUPIR (Scaling-UP Image Restoration), a cutting-edge image enhancement and upscaling model introduced in the paper Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wild.

This model is simply mind-blowing. At the bottom of this post, you will see side-by-side comparisons of SUPIR versus the extremely expensive online service, Magnific AI. Magnific is known to be the best among the community. However, SUPIR is by far superior. SUPIR also significantly outperforms Topaz AI upscale. SUPIR manages to remain faithful to the original image almost 100% while adding details and achieving super upscaling with the best realism.

I made a full 33-minute tutorial, fully chaptered with manually written captions. The chapter's info is posted at the very bottom.

You can watch the video here: SUPIR: New SOTA Open Source Image Upscaler & Enhancer Model Better Than Magnific & Topaz AI Tutorial

SUPIR: New SOTA Open Source Image Upscaler & Enhancer Model Better Than Magnific & Topaz AI Tutorial

image

You can join our 6500+ member Discord for any help & discussion: https://discord.com/servers/software-engineering-courses-secourses-772774097734074388

Original repo of SUPIR: https://github.com/Fanghua-Yu/SUPIR

I have worked hard to make a 1-click installer for Windows & RunPod. RunPod uses Linux, thus if you are a Linux user you can use RunPod files to install locally on Linux as well with a 1-click install.

Full instructions are shared in this post along with the scripts: https://www.patreon.com/posts/supir-1-click-99176057

Here are the installer files:

image

The installer works with Python 3.10.11. It generates a new pip venv and installs everything there. So you don't need Conda. Since it will generate its own VENV, it will not affect any other installations on your system.

The installer installs xFormers and Triton (we are using a pre-compiled wheel) and Pytorch 2.2.0 automatically for you on Windows and Linux.

The Gradio app launching interface is shown below:

image

Currently, with the newest optimizations, the SUPIR app works great on RTX 3060 without LLaVA. I have tested it on my 12 GB single RTX 3060 GPU. So if you have a GPU that has 12GB or more VRAM, you can use it.

The installer downloads all models automatically as well. Also, I changed the base SDXL model with Juggernaut XL - V9 since it works better.

You can simply use any SDXL model. Instructions are on the Patreon post.

I also greatly improved the base Gradio APP. I made the interface more usable.

I added the number of images and randomized seed features. I made the image upscale scaler 0.1 precision.

Moreover, I have added a batch upscale feature as well.

You can see the improved advanced Gradio app interface below.

All the images the app generates will be automatically saved under the outputs folder. You can define the batch image processing outputs folder as well.

image

Here is the content of the Patreon post:

image

The chapters of the tutorial are as follows:

  • 0:00 Introduction to SUPIR (Scaling-UP Image Restoration) full tutorial
  • 2:10 How to download and install SUPIR on Windows or RunPod (thus Linux)
  • 3:19 How to setup a community Pod on RunPod's newest interface
  • 4:33 How to install and start SUPIR on RunPod
  • 7:10 How to use Proxy connect of RunPod
  • 8:13 How to install and start our own quantization supporting LLaVA
  • 9:22 Getting image description from our own LLaVA model
  • 9:42 How to use SUPIR interface and testing camel image (test image 1) on SUPIR in details
  • 12:07 Testing a very old family photo enhancement and upscaling with SUPIR (test image 2)
  • 14:34 Where the generated images are saved
  • 14:53 Testing the image of Arnold Schwarzenegger as a warrior (test image 3) on SUPIR in details
  • 16:22 The effect of simple prompt vs detailed prompt
  • 17:30 Testing a dragon statue enhancement and upscaling with SUPIR (test image 4)
  • 17:42 How I used ChatGPT Plus / GPT-4 for image captioning
  • 18:29 The model works with literally every resolution and example very big upscale
  • 19:00 Testing image of a dinosaur in jurassic park image enhancement and upscaling with SUPIR (test image 5)
  • 19:41 From 500px to 3000px upscale results and how to do very big upscale properly
  • 22:39 GPU utilization of the SUPIR scripts
  • 23:15 If you get out of VRAM error what can you do and how you can solve
  • 25:22 Testing a MonsterMMORPG Game character (anime like drawing) upscaling and image enhancing (test image 6)
  • 25:39 What to do if your image has transparent pixels to be able to upscale
  • 27:35 Testing a black and white colored movie screenshot of a man image enhancement and upscaling with SUPIR (test image 7)
  • 28:29 Testing a screenshot from the movie Predator enhancement and upscaling with SUPIR (test image 8)
  • 29:12 The queue ability of the Gradio app of SUPIR
  • 29:49 Testing an old photo of Muhammad Ali in a boxing stance image enhancement and upscaling with SUPIR (test image 9)
  • 30:45 Testing a black and white colored movie screenshot of Charlie Chaplin image enhancement and upscaling with SUPIR (test image 10)

SUPIR vs MAGNIFIC AI

Carefully look at the how much SUPIR can be loyal to the original image vs Magnific can be loyal to original image

base_ali

magnific_ali

supir_ali

base_dino

dino_magnific

dino_supir

base_family

magnific_family

supir_family

base_camel

magnific_camel

supir_camel

base_vampire

magnific_vampire

supir_vampire

base_dragon

magnific_dragon

supir_dragon

base_arnold

magnific_arnold

supir_arnold

base_predator

magnific_predator

supir_predator

base_charlie

magnific_charlie

supir_charlie

base_monster

magnific_monster

supir_monster

FurkanGozukara avatar Feb 28 '24 02:02 FurkanGozukara

You deserve ban for posting your "premium" sh**y stuff here. Everything can be done with following authors readme file.

zelenooki87 avatar Feb 28 '24 09:02 zelenooki87

Can you please ban this guy ?

Revln9 avatar Feb 28 '24 09:02 Revln9

Hello and thanks for your work! You made a great video and your results are very important to us. Maybe someone else thinks it's inappropriate to post this as an issue. We can make it better and find you a better place to share your thoughts!

JasonGUTU avatar Feb 28 '24 11:02 JasonGUTU

Hello and thanks for your work! You made a great video and your results are very important to us. Maybe someone else thinks it's inappropriate to post this as an issue. We can make it better and find you a better place to share your thoughts!

Thank you so much. I will hopefully make more people to know this Model. It is not getting the attention it deserves.

FurkanGozukara avatar Feb 28 '24 11:02 FurkanGozukara

https://github.com/Fanghua-Yu/SUPIR

no paywall, one click installer

friendlyFriend4000 avatar Feb 28 '24 13:02 friendlyFriend4000

I tried to install, based on the readme, but got a bunch of errors when installing requirements.

2024-02-28 22_47_26-Anaconda Prompt

Akarity avatar Feb 28 '24 21:02 Akarity

@Akarity I made it installed via Python 3.10.11 venv. I really don't like Conda

FurkanGozukara avatar Feb 28 '24 22:02 FurkanGozukara

https://github.com/Fanghua-Yu/SUPIR

no paywall, one click installer

there is no one click installer on this page

OoAnikioO avatar Mar 02 '24 08:03 OoAnikioO

New updates added to our Gradio. I keep adding features requested by the supporters

https://www.patreon.com/posts/99176057

image

image metadata

updated interface

image

FurkanGozukara avatar Mar 02 '24 14:03 FurkanGozukara

people would have less of a problem with this he didn't put it behind a paywall. this isn't helping anyone but his own pockets. Sure people need to make money, but it's done in such a sh*tty and spammy way - everywhere!

csatoshii avatar Mar 03 '24 13:03 csatoshii

Just updated to V19

image

image

image

FurkanGozukara avatar Mar 04 '24 00:03 FurkanGozukara

We updated to V21 and we got some SUPIR improvements

new updates

new options

show off

metadata

FurkanGozukara avatar Mar 05 '24 00:03 FurkanGozukara

We just made a new big update V22

Auto generate comparison video

https://github.com/Fanghua-Yu/SUPIR/assets/19240467/60b9f4e1-f968-4d26-8333-553739f7b8a5

v22

FurkanGozukara avatar Mar 05 '24 19:03 FurkanGozukara

GitHub policy isn't working here? Ban this patreon $$ "developer", please. He is spamming everywhere.

alcoartist avatar Mar 06 '24 06:03 alcoartist

How can I use it inside Pinokio?

PierrunoYT avatar Mar 09 '24 09:03 PierrunoYT

We have been working non stop and added so many features

You can download and use from here standalone fully auto installer including download models : https://www.patreon.com/posts/supir-1-click-99176057

@PierrunoYT

https://github.com/Fanghua-Yu/SUPIR/assets/19240467/fa10341f-9f07-4d9c-8926-1f73ebe1bdaa

new features

image

image

FurkanGozukara avatar Mar 11 '24 03:03 FurkanGozukara

We are now version 41 : https://www.patreon.com/posts/99176057

Here look at all the features we brought

Displaying full status of upscale

image

image

Auto make comparison video

https://github.com/Fanghua-Yu/SUPIR/assets/19240467/81787dd7-5f1a-4f6b-83f4-259d02726750

Look all the options and changelogs

image

We now have even process video input automatically

image

image

FurkanGozukara avatar Mar 17 '24 11:03 FurkanGozukara