dedupe topic
duplicut
Remove duplicates from MASSIVE wordlist, without sorting it (for dictionary-based password cracking)
mail-deduplicate
📧 CLI to deduplicate mails from mail boxes.
recordlinkage
A powerful and modular toolkit for record linkage and duplicate detection in Python
jdupes
A powerful duplicate file finder and an enhanced fork of 'fdupes'.
free-style
Make CSS easier and more maintainable by using JavaScript
borg
Deduplicating archiver with compression and authenticated encryption.
restic
Fast, secure, efficient backup program
dedupe
:id: A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
zingg
Scalable identity resolution, entity resolution, data mastering and deduplication using ML
yarn-deduplicate
Deduplication tool for yarn.lock files