nebula
nebula copied to clipboard
Published
20 hours ago •
slackhq
slackhq
Slow Windows Performance
Hello, We are having issues with performance in Windows 10 using the newest release (1.5.0 and 1.4). We have been running iperf3 tests to understand the VPN network speeds, we have replicated this issue in a couple of environments mixing combinations of windows and Linux machines.
The issue was first seen in transfers from an Azure Server to client machines.
In summary, we see the worst performance when we are communicating windows to windows. slightly better performance windows Linux and near network speed performance Linux to Linux.
A sample of what have seen is below. In this scenario, two pcs are located on a local LAN between a Linux and Windows machine.
A direct iperf between these two machines yields a result ~800 Mbit/s and the nebula results:
PS C:\iperf-3.1.3-win32> .\iperf3 -R -c 10.15.15.4
Connecting to host 10.15.15.4, port 5201
Reverse mode, remote host 10.15.15.4 is sending
[ 4] local 10.15.15.7 port 1063 connected to 10.15.15.4 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 1.14 MBytes 9.53 Mbits/sec
[ 4] 1.00-2.00 sec 856 KBytes 7.01 Mbits/sec
[ 4] 2.00-3.00 sec 790 KBytes 6.48 Mbits/sec
[ 4] 3.00-4.00 sec 2.11 MBytes 17.7 Mbits/sec
[ 4] 4.00-5.00 sec 1.82 MBytes 15.3 Mbits/sec
[ 4] 5.00-6.00 sec 905 KBytes 7.40 Mbits/sec
[ 4] 6.00-7.00 sec 1.08 MBytes 9.05 Mbits/sec
[ 4] 7.00-8.00 sec 1.09 MBytes 9.14 Mbits/sec
[ 4] 8.00-9.00 sec 724 KBytes 5.93 Mbits/sec
[ 4] 9.00-10.00 sec 671 KBytes 5.50 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 11.3 MBytes 9.51 Mbits/sec 2 sender
[ 4] 0.00-10.00 sec 11.2 MBytes 9.41 Mbits/sec receiver
Where IP of the computer running the command is 10.15.15.7 (Windows), and the computer with iperf3 -s running is 10.15.15.4 (Linux). A connection to the lighthouse should have already been established. The lighthouse ip is 10.0.0.1. It should also be noted that we are using the wireguard Wintun drivers as well. We have modified the nebula config and environment trying various settings at the time of these results: read_buffer: (Currently at 20000000) write_buffer: (Currently at 20000000) tx_queue: (Currently at 1000) mtu: (Currently at 2300) cipher: AES Network adapter settings in windows
In addition, we have tried nebula/iperf3 with higher process priorities with only a minor 5-10% improvement.
In our worst-case scenario Azure server to windows desktop, we have seen download speeds peak at 1-2 Mbits/s when we expect the link speed to be closer to 100 Mbits/s
Overall, We have not had much luck with getting the download performance to be more than 30 Mbits/sec when a Windows machine is receiving data in any of the environments.
It should be noted that running iperf3 without the reverse flag (Sending from windows to a Linux machine) performs slightly but still well below the direct link speed
PS C:\iperf-3.1.3-win32> .\iperf3 -c 10.15.15.4
Connecting to host 10.15.15.4, port 5201
[ 4] local 10.15.15.7 port 1209 connected to 10.15.15.4 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 4.98 MBytes 41.8 Mbits/sec
[ 4] 1.00-2.00 sec 5.29 MBytes 44.4 Mbits/sec
[ 4] 2.00-3.00 sec 5.04 MBytes 42.3 Mbits/sec
[ 4] 3.00-4.00 sec 5.11 MBytes 42.8 Mbits/sec
[ 4] 4.00-5.00 sec 5.04 MBytes 42.3 Mbits/sec
[ 4] 5.00-6.00 sec 4.92 MBytes 41.3 Mbits/sec
[ 4] 6.00-7.00 sec 5.04 MBytes 42.3 Mbits/sec
[ 4] 7.00-8.00 sec 4.80 MBytes 40.2 Mbits/sec
[ 4] 8.00-9.00 sec 4.80 MBytes 40.3 Mbits/sec
[ 4] 9.00-10.00 sec 5.04 MBytes 42.3 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 50.1 MBytes 42.0 Mbits/sec sender
[ 4] 0.00-10.00 sec 50.0 MBytes 42.0 Mbits/sec receiver
Config File (same on both computers):
# PKI defines the location of credentials for this node. Each of these can also be inlined by using the YAML ": |" syntax.
pki:
# The CAs that are accepted by this node. Must contain one or more certificates created by 'nebula-cert ca'
ca: ./ca.crt
cert: ./test/host.crt
key: ./test/host.key
static_host_map:
"10.0.0.1": ["<<<my lighthouse ip: port>>>"]
lighthouse:
am_lighthouse: false
interval: 60
hosts:
- "10.0.0.1"
# Port Nebula will be listening on. Using port 0 will dynamically assign a port.
listen:
host: 0.0.0.0
port: 0
read_buffer: 20000000
write_buffer: 20000000
punchy:
punch: true
respond: true
tun:
disabled: false
# Name of the device
dev: nebula_vpn
# Toggles forwarding of local broadcast packets, the address of which depends on the ip/mask encoded in pki.cert
drop_local_broadcast: false
# Toggles forwarding of multicast packets
drop_multicast: false
# Sets the transmit queue length, if you notice lots of transmit drops on the tun it may help to raise this number. Default is 500
tx_queue: 10000
# Default MTU for every packet, safe setting is (and the default) 1300 for internet based traffic
mtu: 2300
# Route based MTU overrides, you have known vpn ip paths that can support larger MTUs you can increase/decrease them here
routes:
unsafe_routes:
logging:
# panic, fatal, error, warning, info, or debug. Default is info
level: info
format: text
# Nebula security group configuration
firewall:
conntrack:
tcp_timeout: 12m
udp_timeout: 3m
default_timeout: 10m
max_connections: 100000
outbound:
# Allow all outbound traffic from this node
- port: any
proto: any
host: any
inbound:
# Allow icmp between any nebula hosts
- port: any
proto: icmp
host: any
# Allow any protocol from any host within a network group
- port: any
proto: any
group: group1
Config File (for the lighthouse):
# PKI defines the location of credentials for this node. Each of these can also be inlined by using the yaml ": |" syntax.
pki:
# The CAs that are accepted by this node. Must contain one or more certificates created by 'nebula-cert ca'
ca: ./ca.crt
cert: ./lighthouse1/lighthouse1.crt
key: ./lighthouse1/lighthouse1.key
lighthouse:
am_lighthouse: true
interval: 60
# Port Nebula will be listening on. Using port 0 will dynamically assign a port.
listen:
host: 0.0.0.0
port: 443
#
punch:
punchy: true
punch_back: true
#cipher: chachapoly
tun:
disabled: false
# Name of the device
dev: lighthouse-1
# Toggles forwarding of local broadcast packets, the address of which depends on the ip/mask encoded in pki.cert
drop_local_broadcast: false
# Toggles forwarding of multicast packets
drop_multicast: false
# Sets the transmit queue length, if you notice lots of transmit drops on the tun it may help to raise this number. Default is 500
tx_queue: 500
# Default MTU for every packet, safe setting is (and the default) 1300 for internet based traffic
mtu: 1300
# Route based MTU overrides, you have known vpn ip paths that can support larger MTUs you can increase/decrease them here
routes:
unsafe_routes:
logging:
# panic, fatal, error, warning, info, or debug. Default is info
level: info
format: text
# Nebula security group configuration
firewall:
conntrack:
tcp_timeout: 120h
udp_timeout: 3m
default_timeout: 10m
max_connections: 100000
outbound:
- port: any
proto: any
host: any
inbound:
- port: any
proto: any
host: any
Output logs from nebula (with debug enabled while running the test):
time="2021-11-16T11:19:19-05:00" level=debug msg="Trusted CA fingerprints" fingerprints="[62b4b249e68c0312b251c420c5e7b475280b55603a6fa40e035f4591ddf17ed2]"
time="2021-11-16T11:19:19-05:00" level=debug msg="Client nebula certificate" cert="NebulaCertificate {\n\tDetails {\n\t\tName: 618eede181ee9368e0e073bc\n\t\tIps: [\n\t\t\t10.15.15.7/8\n\t\t]\n\t\tSubnets: []\n\t\tGroups: [\n\t\t\t\"6173027b606b663d7e61a181\"\n\t\t]\n\t\tNot before: 2021-11-12 18:00:10 -0500 EST\n\t\tNot After: 2022-10-20 11:04:42 -0400 EDT\n\t\tIs CA: false\n\t\tIssuer: 62b4b249e68c0312b251c420c5e7b475280b55603a6fa40e035f4591ddf17ed2\n\t\tPublic key: fe3a25cb3e58f69900db1e502cf134808b5737d22ce20c8b8a7633ca4d3c860b\n\t}\n\tFingerprint: f7d7b4f2b29604c0fb9cff0d53082d7f0220031c41134b52521efbce6e3235cd\n\tSignature: 483b64c564471302a9694aae227cf38f0714a3c98145de4d4286c770b4c3a15a5b6e700cb093c58d44e41d1542e9b7c5660f5209d27cec5ae29a9c6124671b08\n}"
time="2021-11-16T11:19:19-05:00" level=info msg="Firewall rule added" firewallRule="map[caName: caSha: direction:outgoing endPort:0 groups:[] host:any ip: proto:0 startPort:0]"
time="2021-11-16T11:19:19-05:00" level=info msg="Firewall rule added" firewallRule="map[caName: caSha: direction:incoming endPort:0 groups:[] host:any ip: proto:1 startPort:0]"
time="2021-11-16T11:19:19-05:00" level=info msg="Firewall rule added" firewallRule="map[caName: caSha: direction:incoming endPort:0 groups:[6173027b606b663d7e61a181] host: ip: proto:0 startPort:0]"
time="2021-11-16T11:19:19-05:00" level=info msg="Firewall started" firewallHash=dca22fcc82fb1d8e537eb86e117dab62a7c845a527577adc45f7dcecc5f081bf
2021/11/16 11:19:19 Using existing driver 0.14
2021/11/16 11:19:19 Creating adapter
time="2021-11-16T11:19:19-05:00" level=info msg="Main HostMap created" network=10.15.15.7/8 preferredRanges="[]"
time="2021-11-16T11:19:19-05:00" level=info msg="UDP hole punching enabled"
time="2021-11-16T11:19:20-05:00" level=info msg="Nebula interface is active" build=1.5.0 interface=nebula_vpn network=10.15.15.7/8 udpAddr="[::]:54266"
time="2021-11-16T11:19:20-05:00" level=debug msg="Error while validating outbound packet: packet is not ipv4, type: 6" packet="[96 0 0 0 0 24 58 255 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 255 2 0 0 0 0 0 0 0 0 0 1 255 47 182 24 135 0 84 53 0 0 0 0 254 128 0 0 0 0 0 0 201 70 166 27 76 47 182 24]"
time="2021-11-16T11:19:20-05:00" level=debug msg="Error while validating outbound packet: packet is not ipv4, type: 6" packet="[96 0 0 0 0 8 58 255 254 128 0 0 0 0 0 0 201 70 166 27 76 47 182 24 255 2 0 0 0 0 0 0 0 0 0 0 0 0 0 2 133 0 11 141 0 0 0 0]"
time="2021-11-16T11:19:20-05:00" level=debug msg="Error while validating outbound packet: packet is not ipv4, type: 6" packet="[96 0 0 0 0 36 0 1 254 128 0 0 0 0 0 0 201 70 166 27 76 47 182 24 255 2 0 0 0 0 0 0 0 0 0 0 0 0 0 22 58 0 5 2 0 0 1 0 143 0 73 23 0 0 0 1 4 0 0 0 255 2 0 0 0 0 0 0 0 0 0 1 255 47 182 24]"
time="2021-11-16T11:19:20-05:00" level=debug msg="Error while validating outbound packet: packet is not ipv4, type: 6" packet="[96 0 0 0 0 36 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 255 2 0 0 0 0 0 0 0 0 0 0 0 0 0 22 58 0 5 2 0 0 1 0 143 0 186 66 0 0 0 1 3 0 0 0 255 2 0 0 0 0 0 0 0 0 0 1 255 47 182 24]"
time="2021-11-16T11:19:20-05:00" level=debug msg="Error while validating outbound packet: packet is not ipv4, type: 6" packet="[96 0 0 0 0 36 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 255 2 0 0 0 0 0 0 0 0 0 0 0 0 0 22 58 0 5 2 0 0 1 0 143 0 110 128 0 0 0 1 4 0 0 0 255 2 0 0 0 0 0 0 0 0 0 0 0 0 0 12]"
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 59907 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="Error while validating outbound packet: packet is not ipv4, type: 6" packet="[96 0 0 0 0 56 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 255 2 0 0 0 0 0 0 0 0 0 0 0 0 0 22 58 0 5 2 0 0 1 0 143 0 106 117 0 0 0 2 4 0 0 0 255 2 0 0 0 0 0 0 0 0 0 0 0 1 0 3 4 0 0 0 255 2 0 0 0 0 0 0 0 0 0 0 0 0 0 251]"
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 63745 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 63746 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 49618 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 38228 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="Generated index" index=4226112570
time="2021-11-16T11:19:20-05:00" level=debug msg="Packet store" length=1 stored=true vpnIp=10.0.0.1
time="2021-11-16T11:19:20-05:00" level=debug msg="Generated index" index=885174028
time="2021-11-16T11:19:20-05:00" level=debug msg="HandshakeManager: triggered" vpnIp=10.0.0.1
time="2021-11-16T11:19:20-05:00" level=debug msg="Packet store" length=1 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:20-05:00" level=debug msg="Packet store" length=2 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:20-05:00" level=info msg="Handshake message sent" handshake="map[stage:1 style:ix_psk0]" initiatorIndex=4226112570 udpAddrs="[<PUBLIC IP>:443]" vpnIp=10.0.0.1
time="2021-11-16T11:19:20-05:00" level=info msg="Handshake message received" certName=lighthouse1 durationNs=20001300 fingerprint=05df2528b6ee8d033acebceb1b439419443bfdb178475905d0b1f75d472d0be6 handshake="map[stage:2 style:ix_psk0]" initiatorIndex=4226112570 issuer=62b4b249e68c0312b251c420c5e7b475280b55603a6fa40e035f4591ddf17ed2 remoteIndex=4226112570 responderIndex=2825880774 sentCachedPackets=1 udpAddr="<PUBLIC IP>:443" vpnIp=10.0.0.1
time="2021-11-16T11:19:20-05:00" level=debug msg="Hostmap vpnIp added" hostMap="map[hostinfo:map[existing:true hostId:10.0.0.1 localIndexId:4226112570] mapName:main mapTotalSize:1 vpnIp:10.0.0.1]"
time="2021-11-16T11:19:20-05:00" level=debug msg="Hostmap hostInfo deleted" hostMap="map[indexNumber:4226112570 mapName:pending mapTotalSize:1 remoteIndexNumber:2825880774 vpnIp:10.0.0.1]"
time="2021-11-16T11:19:20-05:00" level=debug msg="Sending 1 stored packets" certName=lighthouse1 vpnIp=10.0.0.1
time="2021-11-16T11:19:20-05:00" level=debug msg="Packet store" length=3 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:20-05:00" level=debug msg="Packet store" length=4 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:20-05:00" level=debug msg="Packet store" length=5 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55420 1900 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55420 1900 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55420 1900 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55420 1900 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55420 1900 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 55133 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:20-05:00" level=debug msg="Error while validating outbound packet: packet is not ipv4, type: 6" packet="[96 0 0 0 0 96 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 255 2 0 0 0 0 0 0 0 0 0 0 0 0 0 22 58 0 5 2 0 0 1 0 143 0 175 239 0 0 0 4 3 0 0 0 255 2 0 0 0 0 0 0 0 0 0 1 255 47 182 24 4 0 0 0 255 2 0 0 0 0 0 0 0 0 0 0 0 0 0 12 4 0 0 0 255 2 0 0 0 0 0 0 0 0 0 0 0 1 0 3 4 0 0 0 255 2 0 0 0 0 0 0 0 0 0 0 0 0 0 251]"
time="2021-11-16T11:19:20-05:00" level=debug msg="Packet store" length=6 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:20-05:00" level=debug msg="Packet store" length=7 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:20-05:00" level=debug msg="Packet store" length=8 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:21-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:21-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:21-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:21-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:21-05:00" level=debug msg="Packet store" length=9 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:21-05:00" level=debug msg="Packet store" length=10 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:21-05:00" level=debug msg="Packet store" length=11 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:21-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="Packet store" length=12 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:22-05:00" level=debug msg="Packet store" length=13 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="Packet store" length=14 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:22-05:00" level=debug msg="Packet store" length=15 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 63271 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 60550 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 61784 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 54917 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="Packet store" length=16 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:22-05:00" level=debug msg="Packet store" length=17 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:22-05:00" level=debug msg="Packet store" length=18 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 63271 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 60550 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 61784 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 54917 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55420 1900 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:22-05:00" level=debug msg="Packet store" length=19 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:22-05:00" level=debug msg="Packet store" length=20 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:22-05:00" level=debug msg="Packet store" length=21 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:22-05:00" level=debug msg="Packet store" length=22 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:22-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="Packet store" length=23 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55420 1900 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55420 1900 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55420 1900 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55420 1900 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55420 1900 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:23-05:00" level=debug msg="Packet store" length=24 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:23-05:00" level=debug msg="Packet store" length=25 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:23-05:00" level=debug msg="Packet store" length=26 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:23-05:00" level=debug msg="Packet store" length=27 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:24-05:00" level=debug msg="Error while validating outbound packet: packet is not ipv4, type: 6" packet="[96 0 0 0 0 8 58 255 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 255 2 0 0 0 0 0 0 0 0 0 0 0 0 0 2 133 0 123 184 0 0 0 0]"
time="2021-11-16T11:19:24-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:24-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:24-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="Packet store" length=28 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="Packet store" length=29 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="Packet store" length=30 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="Packet store" length=31 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 56558 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="Packet store" length=32 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 54519 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 61153 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55702 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:25-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55420 1900 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 56558 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 54519 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 61153 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55702 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="Packet store" length=33 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:26-05:00" level=debug msg="Packet store" length=34 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:26-05:00" level=debug msg="Packet store" length=35 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:26-05:00" level=debug msg="Packet store" length=36 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:26-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:27-05:00" level=debug msg="Packet store" length=37 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:27-05:00" level=debug msg="Packet store" length=38 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:27-05:00" level=debug msg="Packet store" length=39 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:27-05:00" level=debug msg="Packet store" length=40 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:28-05:00" level=debug msg="Error while validating outbound packet: packet is not ipv4, type: 6" packet="[96 0 0 0 0 8 58 255 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 255 2 0 0 0 0 0 0 0 0 0 0 0 0 0 2 133 0 123 184 0 0 0 0]"
time="2021-11-16T11:19:28-05:00" level=debug msg="Tunnel status" certName=lighthouse1 tunnelCheck="map[method:active state:testing]" vpnIp=10.0.0.1
time="2021-11-16T11:19:28-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55420 1900 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:28-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:28-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:29-05:00" level=info msg="Handshake timed out" durationNs=8951588100 handshake="map[stage:1 style:ix_psk0]" initiatorIndex=885174028 remoteIndex=0 udpAddrs="[]" vpnIp=10.255.255.255
time="2021-11-16T11:19:29-05:00" level=debug msg="Hostmap hostInfo deleted" hostMap="map[indexNumber:885174028 mapName:pending mapTotalSize:0 remoteIndexNumber:0 vpnIp:10.255.255.255]"
time="2021-11-16T11:19:30-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 59328 3702 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:30-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 59328 3702 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:30-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 38484 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:30-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 38228 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:30-05:00" level=debug msg="Generated index" index=947926788
time="2021-11-16T11:19:30-05:00" level=debug msg="Packet store" length=1 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:30-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 59328 3702 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:30-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 59328 3702 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:30-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 59328 3702 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:30-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 38228 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:30-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:30-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 59328 3702 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:30-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 59328 3702 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:31-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 59328 3702 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:31-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 59328 3702 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:31-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55420 1900 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:33-05:00" level=debug msg="Generated index" index=3255955150
time="2021-11-16T11:19:33-05:00" level=debug msg="Packet store" length=1 stored=true vpnIp=10.15.15.4
time="2021-11-16T11:19:33-05:00" level=debug msg="HandshakeManager: triggered" vpnIp=10.15.15.4
time="2021-11-16T11:19:33-05:00" level=info msg="Handshake message sent" handshake="map[stage:1 style:ix_psk0]" initiatorIndex=3255955150 udpAddrs="[104.195.135.3:39118 172.17.0.1:39118 172.18.0.1:39118 192.168.30.169:39118]" vpnIp=10.15.15.4
time="2021-11-16T11:19:33-05:00" level=info msg="Handshake message received" certName=617968c543d7b3908832502b durationNs=17733800 fingerprint=b4743dd1fc92890b8ac9fb8f58d129e24389a6bd2f841b6ddefd713e73d37ecb handshake="map[stage:2 style:ix_psk0]" initiatorIndex=3255955150 issuer=62b4b249e68c0312b251c420c5e7b475280b55603a6fa40e035f4591ddf17ed2 remoteIndex=3255955150 responderIndex=1219496328 sentCachedPackets=1 udpAddr="192.168.30.169:39118" vpnIp=10.15.15.4
time="2021-11-16T11:19:33-05:00" level=debug msg="Hostmap vpnIp added" hostMap="map[hostinfo:map[existing:true hostId:10.15.15.4 localIndexId:3255955150] mapName:main mapTotalSize:2 vpnIp:10.15.15.4]"
time="2021-11-16T11:19:33-05:00" level=debug msg="Hostmap hostInfo deleted" hostMap="map[indexNumber:3255955150 mapName:pending mapTotalSize:1 remoteIndexNumber:1219496328 vpnIp:10.15.15.4]"
time="2021-11-16T11:19:33-05:00" level=debug msg="Sending 1 stored packets" certName=617968c543d7b3908832502b vpnIp=10.15.15.4
time="2021-11-16T11:19:33-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 59328 3702 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:33-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 59328 3702 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="Packet store" length=2 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 50784 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="Packet store" length=3 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:34-05:00" level=debug msg="Packet store" length=4 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 49413 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="Packet store" length=5 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 56554 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 56587 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:34-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 55420 1900 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 50784 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 49413 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 56554 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 56587 5355 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="HandshakeManager: triggered" vpnIp=10.15.15.4
time="2021-11-16T11:19:35-05:00" level=debug msg="Packet store" length=6 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:35-05:00" level=debug msg="Packet store" length=7 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:35-05:00" level=debug msg="Packet store" length=8 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:35-05:00" level=debug msg="Packet store" length=9 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 59328 3702 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 59328 3702 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:35-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:36-05:00" level=debug msg="Packet store" length=10 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:36-05:00" level=debug msg="Packet store" length=11 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:36-05:00" level=debug msg="Packet store" length=12 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:36-05:00" level=debug msg="Packet store" length=13 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:36-05:00" level=debug msg="Punching on 39118 for 10.15.15.4"
time="2021-11-16T11:19:36-05:00" level=debug msg="Punching on 39118 for 10.15.15.4"
time="2021-11-16T11:19:36-05:00" level=debug msg="Punching on 39118 for 10.15.15.4"
time="2021-11-16T11:19:36-05:00" level=debug msg="Punching on 39118 for 10.15.15.4"
time="2021-11-16T11:19:36-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:36-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:37-05:00" level=debug msg="HandshakeManager: triggered" vpnIp=10.15.15.4
time="2021-11-16T11:19:37-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 59328 3702 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:37-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:37-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:38-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:39-05:00" level=debug msg="HandshakeManager: triggered" vpnIp=10.15.15.4
time="2021-11-16T11:19:39-05:00" level=info msg="Handshake timed out" durationNs=9341148000 handshake="map[stage:1 style:ix_psk0]" initiatorIndex=947926788 remoteIndex=0 udpAddrs="[]" vpnIp=10.255.255.255
time="2021-11-16T11:19:39-05:00" level=debug msg="Hostmap hostInfo deleted" hostMap="map[indexNumber:947926788 mapName:pending mapTotalSize:0 remoteIndexNumber:0 vpnIp:10.255.255.255]"
time="2021-11-16T11:19:39-05:00" level=debug msg="Tunnel status" tunnelCheck="map[method:passive state:alive]" vpnIp=10.15.15.4
time="2021-11-16T11:19:39-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:39-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:40-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 38484 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:40-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 38228 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:40-05:00" level=debug msg="Generated index" index=87654736
time="2021-11-16T11:19:40-05:00" level=debug msg="Packet store" length=1 stored=true vpnIp=10.255.255.255
time="2021-11-16T11:19:40-05:00" level=debug msg="Punching on 39118 for 10.15.15.4"
time="2021-11-16T11:19:40-05:00" level=debug msg="Punching on 39118 for 10.15.15.4"
time="2021-11-16T11:19:40-05:00" level=debug msg="Punching on 39118 for 10.15.15.4"
time="2021-11-16T11:19:40-05:00" level=debug msg="Punching on 39118 for 10.15.15.4"
time="2021-11-16T11:19:40-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 38228 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:41-05:00" level=debug msg="Tunnel status" tunnelCheck="map[method:active state:alive]" vpnIp=10.0.0.1
time="2021-11-16T11:19:41-05:00" level=debug msg="HandshakeManager: triggered" vpnIp=10.15.15.4
time="2021-11-16T11:19:41-05:00" level=debug msg="Sending a nebula test packet to vpn ip 10.15.15.4"
time="2021-11-16T11:19:43-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:43-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:45-05:00" level=debug msg="Sending a nebula test packet to vpn ip 10.15.15.4"
time="2021-11-16T11:19:46-05:00" level=debug msg="Tunnel status" tunnelCheck="map[method:passive state:alive]" vpnIp=10.15.15.4
time="2021-11-16T11:19:48-05:00" level=debug msg="Punching on 39118 for 10.15.15.4"
time="2021-11-16T11:19:48-05:00" level=debug msg="Punching on 39118 for 10.15.15.4"
time="2021-11-16T11:19:48-05:00" level=debug msg="Punching on 39118 for 10.15.15.4"
time="2021-11-16T11:19:48-05:00" level=debug msg="Punching on 39118 for 10.15.15.4"
time="2021-11-16T11:19:49-05:00" level=debug msg="Tunnel status" tunnelCheck="map[method:passive state:alive]" vpnIp=10.0.0.1
time="2021-11-16T11:19:49-05:00" level=info msg="Handshake timed out" durationNs=9449298700 handshake="map[stage:1 style:ix_psk0]" initiatorIndex=87654736 remoteIndex=0 udpAddrs="[]" vpnIp=10.255.255.255
time="2021-11-16T11:19:49-05:00" level=debug msg="Hostmap hostInfo deleted" hostMap="map[indexNumber:87654736 mapName:pending mapTotalSize:0 remoteIndexNumber:0 vpnIp:10.255.255.255]"
time="2021-11-16T11:19:50-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 38484 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:50-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 38228 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:50-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 38228 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:50-05:00" level=debug msg="HandshakeManager: triggered" vpnIp=10.15.15.4
time="2021-11-16T11:19:51-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:51-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:52-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:52-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:53-05:00" level=debug msg="Sending a nebula test packet to vpn ip 10.15.15.4"
time="2021-11-16T11:19:54-05:00" level=debug msg="Tunnel status" tunnelCheck="map[method:passive state:alive]" vpnIp=10.15.15.4
time="2021-11-16T11:19:54-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:54-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:54-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:58-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:58-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 5353 5353 17 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:19:59-05:00" level=debug msg="Tunnel status" tunnelCheck="map[method:passive state:alive]" vpnIp=10.0.0.1
time="2021-11-16T11:20:00-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 38484 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:20:00-05:00" level=debug msg="dropping outbound packet, vpnIp not in our CIDR or in unsafe routes" fwPacket="&{10.15.15.7 <PUBLIC IP> 8704 38228 2 false}" vpnIp=<PUBLIC IP>
time="2021-11-16T11:20:00-05:00" level=info msg="Caught signal, shutting down" signal=interrupt
time="2021-11-16T11:20:00-05:00" level=debug msg="Hostmap hostInfo deleted" hostMap="map[indexNumber:4226112570 mapName:main mapTotalSize:1 remoteIndexNumber:2825880774 vpnIp:10.0.0.1]"
time="2021-11-16T11:20:00-05:00" level=debug msg="Sending close tunnel message" udpAddr="<PUBLIC IP>:443" vpnIp=10.0.0.1
time="2021-11-16T11:20:00-05:00" level=debug msg="deleting 10.15.15.4 from lighthouse."
time="2021-11-16T11:20:00-05:00" level=debug msg="Hostmap hostInfo deleted" hostMap="map[indexNumber:3255955150 mapName:main mapTotalSize:0 remoteIndexNumber:1219496328 vpnIp:10.15.15.4]"
time="2021-11-16T11:20:00-05:00" level=debug msg="Sending close tunnel message" udpAddr="192.168.30.169:39118" vpnIp=10.15.15.4
time="2021-11-16T11:20:00-05:00" level=info msg=Goodbye
Please let us know of anything else we can change, test or modify to help improve the results of nebula for Windows 10.
We are interested in the impact of #410 and wonder if we should wait for buffering to be enabled in Windows before we use it in our production environment.
I am working with @Curtis-MIlo he may answer your questions as well.
Thank you as well for all your hard work!!
Stieneee
This is expected since we haven't really paid any attention to windows performance until very recently. We have some early code that dramatically increases performance on windows over here. Would really appreciate your performance tests against this branch, if you don't mind building from source.
Nate,
We tried the build. Looks good. A quick summary
Local Lan Test (Down/Up Mbits/s from Windows perspective) Windows <-> Linux Direct Iperf - 800/800 1.5 - 40/9 26c1229b219160f7dc868ead5958d6a448f75973 - ~180/~180
Azure Previous Worst Case Scenario (Down/Up Mbits/s) Windows <-> Windows 1.5 - 1/10 26c1229b219160f7dc868ead5958d6a448f75973 - 120/10 Down/Up - Full Link Speed
Best Case Windows VM <-> Linux Host Virtual Box Bridged Network Adapter 26c1229b219160f7dc868ead5958d6a448f75973 1.5 Gbits/s / 900 Mbits/s (Down/Up Windows Guest)
We will try it out for a couple of days and let you know if we see anything out of the norm.
We don't have an explanation for the performance discrepancy between the Local Lan test and the VM Guest to Host test.
Any chance this branch will hit 1.6? Anything we can do to help?
The new branch looks promising.
I tested with two Windows hosts. One computer has a mechanical hard drive. http transfers with nebula on branch 26c1229 - 30MB/s http transfers without nebula - 60MB/s
http transfers with nebula release 1.5.0 - 200kbps
Hello, Is there any progress regarding improvement of windows performance .
The new branch looks promising.
I tested with two Windows hosts. One computer has a mechanical hard drive. http transfers with nebula on branch 26c1229 - 30MB/s http transfers without nebula - 60MB/s
http transfers with nebula release 1.5.0 - 200kbps
would you please retest with nebula release 1.6 ? Thanks
I am finding it is still very slow with 1.6 and windows 10/server 2016. It would not be usable as a primary VPN for anything needing more than a couple of megs of throughput. With that said, it is highly reliable and is indispensable as a fallback pathway.
I just tested using Nebula 1.6.1 and I can download a file via FileZilla (client and server) directly at 14 MiB/s, but only at 312 KiB/s when I go through Nebula. That is a huge performance hit and makes nebula only usable for updating some configuration.
Is there any more effort being made to improve Windows performance?
I just tested using Nebula 1.6.1 and I can download a file via FileZilla (client and server) directly at 14 MiB/s, but only at 312 KiB/s when I go through Nebula. That is a huge performance hit and makes nebula only usable for updating some configuration.
Is there any more effort being made to improve Windows performance?
Something similar for me. I get about 30 MB/s normal and with nebula i get like 150-350kb/s
