Handling comparisons on identical files with the difference of lacking black bars
I've just witnessed a rather interesting edge case when it comes to running comparisons on two videos that are meant to show the same image but one has hard-coded black bars and the other one does not. For instance, if your ground-truth video has the resolution of 1920x1080 but it has black bars on the top and bottom (the actual "video" content is 21:9, so it would occupy 1920x861 area of the whole video feed), comparing it to a file that is natively of 1920x861 resolution results does not allow the application to properly compute the VMAF metric (not sure about the other ones).
Perhaps consider handling these cases where the compared video streams have the same video "content" but do not share the inclusion of black bars within the video stream by making it such that videos with differing aspect ratios are normalized by either expanding the video stream of the 1920x861 video with black bars or removing them from the ground truth.