telegram_media_downloader
telegram_media_downloader copied to clipboard
Improve the duplicate detection and removal
Is your feature request related to a problem? Please describe. The current duplicate detection has some limitations, it cannot detect all duplicates.
Describe the solution you'd like The script works by checking the files with same name and proceeds to calculate MD5 hashes, if detect duplicates then deletes the files. But this logic mises some duplicates, files with different names but same content. The duplicate detection should be improved by adding an additional checking. If files have the same size but different names, the script should check the hashes for these too and eliminate duplicates.
Describe alternatives you've considered Checking hashes for all files? But this will take a lot of time and slow things down. It should be an option in best case.
This issue has been automatically marked as stale because it has not had recent activity in the past 45 days. It will be closed if no further activity occurs in the next 7 days. Thank you for your contributions.
i did post a similar question in the general discussion , should have been posting it here in issue ?