dnsx icon indicating copy to clipboard operation
dnsx copied to clipboard

Published 20 hours ago • verified publisher icon projectdiscovery

Crash with large dataset and number of threads

Open Mzack9999 opened this issue 2 years ago • 1 comments

dnsx version:

master/main, dev on darwin both with CGO_ENABLED=0, CGO_ENABLED=1 and with sudo

Current Behavior:

The app Crashes with large input dataset (10M targets) and number of threads (-t 10000)

Expected Behavior:

No crashes

Steps To Reproduce:

$ wc -l list.txt 
 10000000 list.txt
$ cat list.txt | go run . -t 10000
[0:00:45] | Hosts: 10000000 | RPS: 4219 | Requests: 190665/10000000 (1%)
runtime/cgo: pthread_create failed: Resource temporarily unavailable
SIGABRT: abort
PC=0x7ff81a5ee00e m=2 sigcode=0

goroutine 0 [idle]:
runtime: unknown pc 0x7ff81a5ee00e
stack: frame={sp:0x70000914dc18, fp:0x0} stack=[0x7000090ce340,0x70000914df40)
0x000070000914db18:  0x0000000000000000  0x0000000000000000 
0x000070000914db28:  0x0000000000000000  0x0000000000000000 
0x000070000914db38:  0x00007ff85bdfe7f0  0x000000000000003c 
0x000070000914db48:  0x0000000005076050  0x000070000914db70 
0x000070000914db58:  0x00007ff81a500c7a  0x00007ff85bdfe7f0 
0x000070000914db68:  0x0000000000000045  0x000070000914dba0 
0x000070000914db78:  0x00007ff81a502c51  0x00007ff85bdfe7f0 
0x000070000914db88:  0x0000000000203001  0x000070000914dcbc 
0x000070000914db98:  0x000070000914dcd0  0x000070000914dc80 
0x000070000914dba8:  0x00007ff81a502be9  0x000070000914dbd0 
0x000070000914dbb8:  0x00007ff81a6240d4  0x00007ff81a573382 
0x000070000914dbc8:  0x00007ff85a31f190  0x0000000000000000 
0x000070000914dbd8:  0x0000000001312d00  0x00007ff85c691a58 
0x000070000914dbe8:  0x000000000000003c  0x000070000914dc10 
0x000070000914dbf8:  0x00007ff81a5e8dcd  0x000000000000003c 
0x000070000914dc08:  0x0000000000000000  0x000070000914dc50 
0x000070000914dc18: <0x00007ff81a6241ff  0x0000000000000003 
0x000070000914dc28:  0x0000000000203001  0x000070000914e000 
0x000070000914dc38:  0x000070000914dc58  0x000070000914dc80 
0x000070000914dc48:  0x00007ff81a56fd24  0x000070000914dca0 
0x000070000914dc58:  0x00000000fffff9df  0xffffffff00000018 
0x000070000914dc68:  0x00007ff85bdfe7f0  0x000070000914dcbc 
0x000070000914dc78:  0x000070000914dcd0  0x000070000914dca0 
0x000070000914dc88:  0x00000000048a7f7e  0x0000000000000000 
0x000070000914dc98:  0x0000000000000023  0x000070000914dd30 
0x000070000914dca8:  0x00000000047d20ea  0x0000000000000000 
0x000070000914dcb8:  0x000000000914dda0  0x0000000000080000 
0x000070000914dcc8:  0xffffffff5be17000  0x0000000054484441 
0x000070000914dcd8:  0x0000000000000000  0x0000000000000000 
0x000070000914dce8:  0x0000000000000000  0x00000000000008ff 
0x000070000914dcf8:  0x0000000010010101  0x0000000000000000 
0x000070000914dd08:  0x0000000000000000  0xa0ce7d67a81a0034 
runtime: unknown pc 0x7ff81a5ee00e
stack: frame={sp:0x70000914dc18, fp:0x0} stack=[0x7000090ce340,0x70000914df40)
0x000070000914db18:  0x0000000000000000  0x0000000000000000 
0x000070000914db28:  0x0000000000000000  0x0000000000000000 
0x000070000914db38:  0x00007ff85bdfe7f0  0x000000000000003c 
0x000070000914db48:  0x0000000005076050  0x000070000914db70 
0x000070000914db58:  0x00007ff81a500c7a  0x00007ff85bdfe7f0 
0x000070000914db68:  0x0000000000000045  0x000070000914dba0 
0x000070000914db78:  0x00007ff81a502c51  0x00007ff85bdfe7f0 
0x000070000914db88:  0x0000000000203001  0x000070000914dcbc 
0x000070000914db98:  0x000070000914dcd0  0x000070000914dc80 
0x000070000914dba8:  0x00007ff81a502be9  0x000070000914dbd0 
0x000070000914dbb8:  0x00007ff81a6240d4  0x00007ff81a573382 
0x000070000914dbc8:  0x00007ff85a31f190  0x0000000000000000 
0x000070000914dbd8:  0x0000000001312d00  0x00007ff85c691a58 
0x000070000914dbe8:  0x000000000000003c  0x000070000914dc10 
0x000070000914dbf8:  0x00007ff81a5e8dcd  0x000000000000003c 
0x000070000914dc08:  0x0000000000000000  0x000070000914dc50 
0x000070000914dc18: <0x00007ff81a6241ff  0x0000000000000003 
0x000070000914dc28:  0x0000000000203001  0x000070000914e000 
0x000070000914dc38:  0x000070000914dc58  0x000070000914dc80 
0x000070000914dc48:  0x00007ff81a56fd24  0x000070000914dca0 
0x000070000914dc58:  0x00000000fffff9df  0xffffffff00000018 
0x000070000914dc68:  0x00007ff85bdfe7f0  0x000070000914dcbc 
0x000070000914dc78:  0x000070000914dcd0  0x000070000914dca0 
0x000070000914dc88:  0x00000000048a7f7e  0x0000000000000000 
0x000070000914dc98:  0x0000000000000023  0x000070000914dd30 
0x000070000914dca8:  0x00000000047d20ea  0x0000000000000000 
0x000070000914dcb8:  0x000000000914dda0  0x0000000000080000 
0x000070000914dcc8:  0xffffffff5be17000  0x0000000054484441 
0x000070000914dcd8:  0x0000000000000000  0x0000000000000000 
0x000070000914dce8:  0x0000000000000000  0x00000000000008ff 
0x000070000914dcf8:  0x0000000010010101  0x0000000000000000 
0x000070000914dd08:  0x0000000000000000  0xa0ce7d67a81a0034

Anything else:

Mzack9999 avatar May 08 '22 15:05 Mzack9999

Not reproducible anymore with latest OSX:

System Version:	macOS 12.4 (21F79)
Kernel Version:	Darwin 21.5.0

The error changed to too many open files without fatal crash

Mzack9999 avatar May 26 '22 15:05 Mzack9999

Closing - will be reopened if the behavior happens again

Mzack9999 avatar Sep 26 '22 11:09 Mzack9999