venom icon indicating copy to clipboard operation
venom copied to clipboard

Speed up Sort

Open theblackturtle opened this issue 6 years ago • 2 comments
trafficstars

Hi, when merging Scraped list and AltDNS list, if you try with large file, the sort tool is very slow. I tried to fix it with LC_ALL=C and -S 50% and it faster ~8 times. This is my command: LC_ALL=C sort -S 50% scraped.lst altdns.lst| uniq > possiblealt.lst

theblackturtle avatar Jun 05 '19 01:06 theblackturtle

Hi @sieunhando, if you use HDD instead of SSD, then it’ll be slow. Because I use SSD, I only tested for SSD. But I’ll surely add your nice approach to the script. Thanks

0daySecured avatar Jun 06 '19 01:06 0daySecured

Why do you use default locale variable?

0daySecured avatar Jun 06 '19 01:06 0daySecured