[Bug]: Oxford pet dataset, fastdup fails on 8 bad images

[dbickson]

What happened?

For example

2024-05-03 10:13:12 [DEBUG] Marking image 5 /Users/dannybickson/Downloads/tom_bad/bad_images/Egyptian_Mau_191.jpg as bad /Users/dannybickson/Downloads/tom_bad/bad_images/Egyptian_Mau_191.jpg ERROR_CORRUPT_IMAGE

What did you expect to see?

No response

What version of fastdup were you runnning on?

1.122

What version of Python were you running on?

Python 3.8

Operating System

MacOSX 12.6.1

Reproduction steps

No response

Relevant log output

No response

Attach a screenshot [Optional]

No response

Contact Details [Optional]

No response

[dbickson]

file /Users/dannybickson/Downloads/tom_bad/bad_images/Abyssinian_34.jpg
/Users/dannybickson/Downloads/tom_bad/bad_images/Abyssinian_34.jpg: GIF image data, version 89a, 250 x 202

[dbickson]

1. Main issue: The file Egyptian_Mau_191.jpg is actually a GIF file but has a .jpg extension, causing OpenCV's imread to fail when trying to decode it as JPEG.

@Tompil3r FYI