hashview-old icon indicating copy to clipboard operation
hashview-old copied to clipboard

Slow hashlist processing speeds

Open JormungandrYggdrasil opened this issue 7 years ago • 3 comments

Upload speeds are slow. At about 500/second this makes me sad.

Big hashlists take days to upload at this speed. I recommend looking at this as other (distributed) hash managers handle this a lot faster on identical hardware.

JormungandrYggdrasil avatar Nov 11 '17 16:11 JormungandrYggdrasil

What hashes are you uploading? How did you get that metric? We're open to options on how to tackle the issue.

On Nov 11, 2017 10:32 AM, "JormungandrYggdrasil" [email protected] wrote:

Upload speeds are slow. At about 500/second this makes me sad.

Big hashlists take days to upload at this speed. I recommend looking at this as other (distributed) hash managers handle this a lot faster.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/hashview/hashview/issues/366, or mute the thread https://github.com/notifications/unsubscribe-auth/ACTh68EaAAVfX1I4jIgAIyvmUNr532slks5s1cwXgaJpZM4Qai_A .

i128 avatar Nov 11 '17 17:11 i128

10M of the MySpace data breach to stress test performance.

JormungandrYggdrasil avatar Nov 13 '17 19:11 JormungandrYggdrasil

Hm, running similar test i can confirm... really slow. I wonder if this would be improved by switching to different backend DB.

i128 avatar Nov 27 '17 22:11 i128