duplicates topic
jscpd
Copy/paste detector for programming source code.
dups
A CLI tool to find/remove duplicate files supporting multi-core and different algorithms (MD5, SHA256, and XXHash).
rmlint
Extremely fast tool to remove duplicates and other lint from your filesystem
GDuplicate-Finder
GDuplicate Finder - A Groovy way to find duplicates among your computer and network shares!
czkawka
Multi functional app to find duplicates, empty folders, similar images etc.
removedupes
Remove Duplicate Messages
redux-dataloader
Loads async data for Redux apps focusing on preventing duplicated requests and dealing with async dependencies.
finddups
Find duplicate files on your computer
python-hashes
Interesting (non-cryptographic) hashes implemented in pure Python.
yarn-deduplicate
Deduplication tool for yarn.lock files