telegram_media_downloader icon indicating copy to clipboard operation
telegram_media_downloader copied to clipboard

Improve the duplicate detection and removal

Open art435 opened this issue 2 years ago • 2 comments

Is your feature request related to a problem? Please describe. The current duplicate detection has some limitations, it cannot detect all duplicates.

Describe the solution you'd like The script works by checking the files with same name and proceeds to calculate MD5 hashes, if detect duplicates then deletes the files. But this logic mises some duplicates, files with different names but same content. The duplicate detection should be improved by adding an additional checking. If files have the same size but different names, the script should check the hashes for these too and eliminate duplicates.

Describe alternatives you've considered Checking hashes for all files? But this will take a lot of time and slow things down. It should be an option in best case.

art435 avatar Dec 11 '22 13:12 art435

This issue has been automatically marked as stale because it has not had recent activity in the past 45 days. It will be closed if no further activity occurs in the next 7 days. Thank you for your contributions.

stale[bot] avatar Mar 18 '23 06:03 stale[bot]

i did post a similar question in the general discussion , should have been posting it here in issue ?

azerfr2 avatar Nov 02 '23 20:11 azerfr2