Anime4K_3.0_Upscale_CNN_UL_x2_Deblur with Anime4K_3.0_ThinLines_HQ.glsl Doesn't Work Freezes MPV.

[Kristijan1001]

Describe the bug When using MPV with Anime4K_3.0_Upscale_CNN_UL_x2_Deblur with Anime4K_3.0_ThinLines_HQ.glsl as soon as you full screen it freezes and it just might move like 1 frame per minute. It is not my CPU or GPU Lacking power, they are nowhere of being maxed out. 2070 SUPER i9900k.

To Reproduce Steps to reproduce the behavior:

1. Enable CTRL+8 change-list glsl-shaders set "~~/shaders/Anime4K_3.0_Upscale_CNN_UL_x2_Deblur.glsl;~~/shaders/Anime4K_3.0_Denoise_Bilateral_Mode.glsl;~~/shaders/Anime4K_3.0_ThinLines_HQ.glsl""

Expected behavior Not to Freeze

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

• OS: Windows 10
• Version v3.0
• GPU 2070 Super
• Media Player and Version MPV v0.31

Offtopic: If someone can point me out on how to get the most quality setup possible. Which shaders should i use to max it out. Also what is the preferred mpv config for max quality (have the one from the suggested tutorial)

[bloc97]

I'm also having the same issues on my end. I think this is something caused by how mpv handles the shaders. Either the GPU has run out of memory or having some other caching issue that mpv can't handle. However, the 2070 Super might not be able to handle the UL version on 1080p video. Have you tried the L version? Also, ThinLines_HQ on 4K is extremely demanding. Consider placing it before the upscale or use the ThinLines_Fast version.

[Y0ba]

Same on 2080ti/9900ks. Just Upscale_CNN_UL_x2 works fine (but there is a lag at the begining) but with DarkLines_HQ and ThinLines_HQ (before upscale) mpv doesn't play video (upscaling 1080p -> 4k) at all. L-version works fine.

Also, ThinLines_HQ on 4K is extremely demanding.

But what about quality? Does it matter where put these shaders (ThinLines and DarkLines): before or after upscale?

[bloc97]

I don't know why UL + Thin + Dark freezes either. I have a Vega 64 GPU and just assumed it was some OS/API or driver issue on my end, but since you guys have the same problem too, maybe we can ask this in the mpv repo. I'm guessing the GPU is running out of shader cores or memory causing excessive caching (would explain why the GPU stays idle).

For quality, it should always be better to put ThinLines and DarkLines at the end (they have more pixels to work with). ThinLines_Fast after upscaling should in theory look better than ThinLines_HQ before upscaling, with the first only slightly slower than the latter.

[Y0ba]

Thanks for the tip. Seems like my videocard can handle both DarkLines_HQ and ThinLines_HQ after upscale with L-variant.

Btw, what do you think about adding x3 variants for direct 720p->4k upscaling?

[bloc97]

I wouldn't mind x3 variants except that I have 9 CNN variants to manage, adding x3 would mean having 18 shaders to manage and 18 different CNNs to train. I will see in the future when I can completely automate shader generation.

[Y0ba]

Btw, checked again and DarkLines_HQ works fine with UL-upscaling. Only UL + Thin freezing video. Even ThinLines_VeryFast freezes video with UL upscale.