Video restoration result quality is below the original

[Atheryl]

Hi,

I am using some old VCR camera records with

python demo/restoration_video_demo.py configs/restorers/real_basicvsr/realbasicvsr_c64b20_1x30x8_lr5e-5_150k_reds.py ~/realbasicvsr_c64b20_1x30x8_lr5e-5_150k_reds_20211104-52f77c2c.pth ~/outside-1.mp4 ./results/outside-1.mp4 --max-seq-len 20

Anything above 20 would make CUDA go out of memory. I do Video to Video (Not sure how to decouple to PNG and rebuild after). I run this on p3.8xlarge EC2 (V100 16GB).

The resulting video is in much worse quality than the original. Is there anything I am missing here?

[wangruohui]

Not sure how to decouple to PNG and rebuild after

You can do this with OpenCV and FFmpeg.

I am not very clear about the reason. Have you tried some other videos?

[Atheryl]

I have tried several videos. Basically the result looks like anime, loss of details on colors and shape.

[wangruohui]

Seems to be a common issue for most SR algorithms. A simple hack is to add some noise to the resulted video. This may lead to a visually more realistic video.

[ckkelvinchan]

I have tried several videos. Basically the result looks like anime, loss of details on colors and shape.

Could you provide us with some examples?

[Atheryl]

Sure, here is 2 PNG

https://imgur.com/a/mi3mcSS

[Atheryl]

A few others:

https://imgur.com/a/BIrptCH https://imgur.com/a/h9fcLs7

[ckkelvinchan]

I just had a look at the images and they are the expected outputs. RealBasicVSR usually struggles when the input is of very low quality.

[YongLD]

@Atheryl Do you know how to use this demo with multi-GPU?

[zengyh1900]

Closing due to inactivity, please reopen if there are any further problems.