duplicate-detection topic
List
duplicate-detection repositories
duplicut
798
Stars
90
Forks
Watchers
Remove duplicates from MASSIVE wordlist, without sorting it (for dictionary-based password cracking)
videohash
259
Stars
35
Forks
Watchers
Near Duplicate Video Detection (Perceptual Video Hashing) - Get a 64-bit comparable hash-value for any video.
removedupes
79
Stars
6
Forks
Watchers
Remove Duplicate Messages
ostap
115
Stars
1
Forks
Watchers
CLI tool that fast checks if your bundle contains multiple versions of the same package, only by looking in package.json.
depp
265
Stars
6
Forks
Watchers
⚡ Check your npm modules for unused and duplicate dependencies fast
fast-near-duplicate-image-search
140
Stars
20
Forks
Watchers
Fast Near-Duplicate Image Search and Delete using pHash, t-SNE and KDTree.
Panako
175
Stars
34
Forks
Watchers
The Panako acoustic fingerprinting system.
SIFTImageSimilarity
164
Stars
39
Forks
Watchers
Interactive code for image similarity using SIFT algorithm
deplicate
76
Stars
16
Forks
Watchers
Advanced Duplicate File Finder for Python
Duplo
86
Stars
21
Forks
Watchers
Duplicates finder for various source code formats.