goreplay icon indicating copy to clipboard operation
goreplay copied to clipboard

v1.3.3 drop packet

Open arrow2012 opened this issue 3 years ago • 11 comments

from v1.3.1 to v1.3.3 gor drop the packet where body is bigger

arrow2012 avatar Dec 24 '21 10:12 arrow2012

record nginx from 2021-12-24 15:09:28 to 2021-12-24 15:24:56

cat 1.log |grep "drill_record_upload" |wc -l
30

URI :/drill_record_upload" only count 30

but I found 8000+ count in nginx accesslog image

arrow2012 avatar Dec 24 '21 10:12 arrow2012

Uploading image.png…

gor command

/usr/local/bin/gor -input-raw :80 -output-file /bak/goreplay/api.xxx.com-request-%Y-%m-%d-%H.log -http-allow-header Host:^api.xxx.com -http-disallow-url /api/health -http-disallow-url /api/ext/xx -http-disallow-url /api/ext/xx -output-file-size-limit 512MB -input-raw-buffer-size 104857600 -copy-buffer-size 104857600 -output-file-queue-limit 0

arrow2012 avatar Dec 24 '21 10:12 arrow2012

Hi! Does it means that 1.3.0 worked for you, you just have not tested this version?

Does your nginx stats also ignore all urls specified in -http-disallow-url and -http-allow-header?

buger avatar Dec 24 '21 15:12 buger

@buger I have tested 1.3.0 worked for me , can get 70%

arrow2012 avatar Dec 25 '21 08:12 arrow2012

v1.3.0 not all urls specified in -http-disallow-url ignore

arrow2012 avatar Dec 25 '21 08:12 arrow2012

when I make install libpcap 1.10, and go build source code v1.3.0 , it dropped to many packets of url "POST drill_record_upload" too

arrow2012 avatar Dec 25 '21 08:12 arrow2012

build command : go build

arrow2012 avatar Dec 25 '21 08:12 arrow2012

go build in CentOS Linux release 7.7.1908

arrow2012 avatar Dec 25 '21 08:12 arrow2012

@buger I have tested 1.3.0 worked for me , can get 70%

hi,I want to use version 1.3.0,but use capture duplicate on Linux,how do you solve this problem?

ruankai88 avatar Jan 06 '22 01:01 ruankai88

go build in CentOS Linux release 7.7.1908

you can try add argument: --input-raw-override-snaplen

puro2016 avatar Jan 27 '22 07:01 puro2016

try user --input-raw-override-snaplen is ok!

huangwnebin avatar Mar 07 '22 07:03 huangwnebin