ffmpeg-quality-metrics icon indicating copy to clipboard operation
ffmpeg-quality-metrics copied to clipboard

add support for more native ffmpeg quality metrics

Open richardpl opened this issue 3 years ago • 11 comments

There is now also vif (Visual Information Fidelity), and soon identity and msad (Mean Sum of Squared Differences).

They also supports slice threading and timeline (calculating quality metrics only for some frame ranges),

richardpl avatar Mar 04 '21 21:03 richardpl

Thanks for the info! I'll probably add an option to calculate them in addition ot the default ones, like for VMAF.

slhck avatar Mar 04 '21 21:03 slhck

VIF is now implemented since version 2.0.

slhck avatar Mar 10 '21 14:03 slhck

Cool.

richardpl avatar Mar 10 '21 15:03 richardpl

Now ffmpeg ...i guess also supports dssim & ms_ssim

ls-milkyway avatar Apr 20 '22 02:04 ls-milkyway

@ls-milkyway Why do you think FFmpeg supports DSSIM? Note that VMAF already includes an MS-SSIM computation.

slhck avatar Apr 20 '22 06:04 slhck

@ls-milkyway Why do you think FFmpeg supports DSSIM? Note that VMAF already includes an MS-SSIM computation.

I mean you can now build ffmpeg with DSSIM...yep MS-SSIM is included; example: ffmpeg -i distorted.mpg -i reference.mpg -lavfi libvmaf='feature=name=ms_ssim' -f null -

ls-milkyway avatar May 03 '22 05:05 ls-milkyway

Please Note: You can add/remove support for more native ffmpeg quality metrics...but please do not change the JSON output structure as I am using it extensively as an input to another program....thanks

ls-milkyway avatar May 03 '22 05:05 ls-milkyway

@ls-milkyway Why do you think FFmpeg supports DSSIM? Note that VMAF already includes an MS-SSIM computation.

I mean you can now build ffmpeg with DSSIM...yep MS-SSIM is included; example: ffmpeg -i distorted.mpg -i reference.mpg -lavfi libvmaf='feature=name=ms_ssim' -f null -

That seems to be a third party addon not provided by FFmpeg itself.

Please Note: You can add/remove support for more native ffmpeg quality metrics...but please do not change the JSON output structure as I am using it extensively as an input to another program....thanks

Sure, I have experienced such problems myself and I'll promise not to change it! I will get back to this issue (and a few other VMAF-related problems) later in May.

slhck avatar May 03 '22 06:05 slhck

That seems to be a third party addon not provided by FFmpeg itself.

Yep, but I guess MS-SSIM is better evaluation than SSIM OR DSSIM...hence you can include MS-SSIM instead of SSIM OR DSSIM. As I am not an expert regarding video quality evaluation algorithms ....just saw some articles....so it's up to you to decide. Thanks.

ls-milkyway avatar May 03 '22 20:05 ls-milkyway

You can get MS-SSIM through VMAF (https://github.com/Netflix/vmaf/blob/master/libvmaf/src/feature/ms_ssim.c), so it should be possible to enable it. I will have to add support to map the respective CLI options though.

slhck avatar May 04 '22 06:05 slhck

Note that MS-SSIM evaluation is now possible starting with version 3.x of this program. See the --vmaf-features option as explained in the README.

slhck avatar Jan 05 '23 09:01 slhck