dedupe topic

Remove duplicates from MASSIVE wordlist, without sorting it (for dictionary-based password cracking)

nil0x42

📧 CLI to deduplicate mails from mail boxes.

kdeldycke

A powerful and modular toolkit for record linkage and duplicate detection in Python

J535D165

A powerful duplicate file finder and an enhanced fork of 'fdupes'.

jbruchon

Make CSS easier and more maintainable by using JavaScript

blakeembrey

Deduplicating archiver with compression and authenticated encryption.

borgbackup

Fast, secure, efficient backup program

restic

:id: A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.

dedupeio

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

zinggAI

Deduplication tool for yarn.lock files

scinos