DNSGrep icon indicating copy to clipboard operation
DNSGrep copied to clipboard

Change split from bytes to lines

Open Not-C-Developer opened this issue 4 years ago • 2 comments

Hi. Change this. from split -b100M rdns.rev.lowercase.txt fileChunk to split -l2000000 rdns.rev.lowercase.txt fileChunk in scripts/fdns_a.sh and scripts/rdns.sh because lose some records when sorting.

Not-C-Developer avatar Sep 13 '20 09:09 Not-C-Developer

Yes true, it has data loss. it fixed my issue too.

j0eii avatar Sep 17 '20 11:09 j0eii

From split's man page: -C, --line-bytes=SIZE put at most SIZE bytes of records per output file

Seems like that would be the best option to use to give you a desired file chunk size without risking data loss.

redNixon avatar Jan 14 '21 13:01 redNixon