BinitDOX
Awesome AI upscaler
Just found a mind-blowing AI upscaler - https://huggingface.co/spaces/gokaygokay/AuraSR-v2. It has even a pytorch version - https://github.com/lucidrains/gigagan-pytorch
Examples. https://senkuro.com/manga/re-monster/chapters/119429828913939988/pages/4
Original image:
Colorized image without upscaling:
Upscaled with RealESRGAN_x4plus_anime_6B:
Upscaled with AuraSR-v2:
Seems good for text and doesn't remove artifacts
ERS:
ASR:
I'll test it in a few hrs.
ESRGAN (Current) (2 seconds):
GigaGAN x4 (AuraSR-v2) (40 seconds) (The space uses this):
GigaGAN x4 Overlapped (AuraSR-v2) (80 seconds):
The AuraSR is for generic use-case, so it's not only larger by x130 times than ESR, but also takes a long time for the upscale.
I don't recommend using it but if you want:
Download https://huggingface.co/fal/AuraSR-v2/blob/main/model.ckpt, rename it as GigaGAN.ckpt and save it in networks folder.
Then run app-stream.py python app-stream.py --no-ssl --upscaler_type=GigaGAN --upscaler_path=networks/GigaGAN.ckpt
Also compare the output with this: https://huggingface.co/spaces/gokaygokay/AuraSR-v2, since this space is not loading for me, and I modified the source code a bit.
PS:
BTW, https://mangadex.org/chapter/d72a3eb8-2b20-4c39-a46f-d282eb05e64f/2 doesn't get colorized.
Oh, just 4s? Great! Must be my GPU then.
Fixed. Does the MC-FJ colorize this?
Oh, MC-FJ also doesn't colorize it...
Is there a way to forcefully colorize an image, and also re-colorize it, when sometimes MC colorizes placeholders?
https://senkuro.com/manga/zettai-ni-damage-wo-ukenai-skill-wo-moratta-node-boukensha-toshite-musou-shitemiru/chapters/136754949798249996/pages/1
MangaColorizer-placeholder-colorization-Video_2024-08-02_23-16-13.webm
Oh, just 4s? Great! Must be my GPU then.
Although, AuraSR-vs size is 2.29GB, but the amount of VRAM it uses is about 7.2GB.
when sometimes MC colorizes placeholders?
Oh I forgot about caches. It caches the wrong image. Should work when caching is off. Will fix.
However, without caching, the load on the system increases, as it has to colorize and upscale again.
Thanks a lot! But, at the moment, when MC encounters placeholders, it starts processing the image, that has the placeholder first, eternally, as it can be seen from the server log and the image from page 7 as an example.
MangaColorizer-placeholder-colorizition-02-Video_2024-08-03_09-33-33.webm
Oh src can change anyways, previous bad fix reverted. Alternate temp fix pushed.
Thank you so much! Now there are no issues with placeholders, but the issue regarding the "Show Original" option occurred:
MangaColorizer-show-original-issue-Video_2024-08-03_18-12-47.mp4
I'm unable to reproduce it. Is it always happening? Can you send me both the logs?
Thank you for your efforts!
Here's the entire process, which is why the screencast turned out a bit long and I had to split it into several parts to meet the size limitations (10 MB) on Github. Please pay attention to the first pages of chapters 1 and 1.5 (they will appear to be exactly the same at the end of the colorization).
Part1
https://github.com/user-attachments/assets/ea45ce20-8d61-4901-bf79-c457196d66fe
Part 2
https://github.com/user-attachments/assets/0c19ec07-ed57-43ed-bd0d-4c03726109d7
Part 3
https://github.com/user-attachments/assets/00f3e94b-0ca0-47f0-b1d7-52b976302c15
Part 4
https://github.com/user-attachments/assets/17854c4b-e46f-4737-990c-d7ca9745a91b
Part 5
https://github.com/user-attachments/assets/1542ccca-e45b-4698-aba5-b533d6244163
Part 6
https://github.com/user-attachments/assets/f279c95d-95b2-4698-a3fd-37a88dba185e
Logs:
Screenshot, big screenshot, really big screenshot
This only occurs with Senkuro right? They load the next chapter if you scroll to the bottom and pages start recoloring due to reuse of page names. But the original still doesn't get affected for me.
Yes, I only noticed it on senkuro.com. Though, I haven't been watching much manga lately, mostly just manhua.