ThreatExchange
ThreatExchange copied to clipboard
Trust & Safety tools for working together to fight digital harms.
Per @thedanielsun key functionality cannot be used without the CLI, and the reference implementation in the cli is too "deep" to easily reuse. Key examples: 1. Fetching is complex, and...
This API was intended to support a fancy data storage model that we don't actually need if we split up downloading from the API and converting to signals, like we...
state.pickle is 5.77 GB Observed memory increased between commit bff909b and 1.0.2, going from 13 GB => 30 GB Command is fetch Current implementation is loading the entire copy in...
See #1108 ``` With Downsaampling/Resizing to 128x128 (original behavior) hamming: 10 expected(python)d8f8f0cce0f4a84f0e370a22028f67f0b36e2ed596623e1d33e6b39c4e9c9b22 d8f8f0cec0f4a84f0637022a278f67f0b36e2ed596621e1d33e6339c4e9c9b22 hamming: 12 expected(python)e64cc9d91e623842f8d1f1d9a398e78c9f199a3bd87924f2b7e11e0bf061b064 e6cc89d93c623842f8d9f1d92398e78c9e199a3b787925f2b7e11e0bf0613164 hamming: 8 expected(python)0007001f003f003f007f00ff00ff00ff01ff01ff01ff03ff03ff03ff03ff03ff 0001000f001f003f007f00ff00ff01ff01ff03ff03ff03ff03ff03ff03ff07ff hamming: 0 expected(python)6227401f601ff4ccafcc9fad4b0d95d371a2eb7265a3285234d228ca94deeb2d 6227401f601ff4ccafcc9fad4b0d95d371a2eb7265a3285234d228ca94deeb2d hamming: 36 expected(python)54a977c221d14c1c43ba5e6e21d4a13989a3553f1462611cbb85fda7be83b677 5481bfd011d1441c411f5f5f6154e13d8883553f1462715dbb85fda59d01f777 hamming:...
I was attempting to use the tmk-clusterize tool on a set of around 50,000 videos and the program crashed before it was finished running. Is there a limit to the...
Directory: ThreatExchange/pdq/cpp -> make Make output: ``` LC_ALL=en_US.UTF-8 LANG=en-US.UTF-8 make main g++ -g -std=c++11 -I../.. -I. -Wall -Wno-char-subscripts -Wno-stringop-truncation -Wno-class-memaccess -Wno-misleading-indentation -Werror -O3 bin/pdq-photo-hasher.cpp common/pdqhashtypes.cpp io/hashio.cpp common/pdqhamming.cpp hashing/pdqhashing.cpp...
In the Java reference implementation, there is a test that asserts that the hash of the sample image "bridge-1-original.jpg" is "f8f8f0cee0f4a84f06370a22038f63f0b36e2ed596621e1d33e6b39c4e9c9b22". See: https://github.com/facebook/ThreatExchange/blob/main/pdq/java/src/test/java/hasher/pdqhashing/PDQHasherTest.java In the C++ readme, the hash of...
Hello, Like there is a default java implementation for PDQ, I think it makes sense having one for TMK. Maybe a JNI/JNA wrapper may be sufficient.
https://swgfl.org.uk/magazine/stopncii-announces-photodna-integration-and-niantic-as-new-industry-partner/ https://swgfl.org.uk/helplines/stopncii/api/
Looks like TAT add a hash exchange API, we should add a reference client, here's the documentation: https://www.terrorismanalytics.org/docs/hash-list-v1 A good 1:1 comparison for how to do this is from StopNCII:...