Video-Inference icon indicating copy to clipboard operation
Video-Inference copied to clipboard

Differing results between .mp4 and sequence upscaling

Open Sazoji opened this issue 4 years ago • 4 comments

Weird blocking occurs when upscaling the same source video sequence (https://files.catbox.moe/3izib4.mp4) when rendered from png files vs rendering from extracted .mp4 frames, presumably with how ffmpeg-python grabs frames. Upscaled from .mp4 video (crf0): https://files.catbox.moe/545jh8.mp4 Upscaled from the same video extracted into a png sequence: https://files.catbox.moe/uu1bfv.mp4

Sazoji avatar Oct 09 '21 07:10 Sazoji

Artifacts look like incorrect colorspace (rec 601 instead of 709, common with ffmpeg reading untagged SD video) unpresent in the source video and chroma issues (even when --denoise is enabled) which might be due to the nature of mpeg chroma subsampling.

Sazoji avatar Oct 09 '21 07:10 Sazoji

Looking into this by seeing other projects with ffmpeg

Sazoji avatar Dec 03 '21 13:12 Sazoji

Been a bit busy and haven't looked into this. I guarantee it has something to do with that weird BGR -> RGB issue I was seeing and "fixed"

joeyballentine avatar Dec 11 '21 19:12 joeyballentine

Colorspace problems are an awful reality with ffmpeg (and only the god knows what happens with the python wrapper) but at most you'd see a slight color shift, not "noisy glitches". EDIT: well, I'm seeing the same dirt even with standalone tacogan, so idk

mirh avatar Mar 29 '22 12:03 mirh