netmaker icon indicating copy to clipboard operation
netmaker copied to clipboard

[Bug]: Unusable network on Oracle Cloud (pure WG works fine).

Open alekc opened this issue 1 year ago • 0 comments

Contact Details

No response

What happened?

I am trying to connect 2 different Oracle Cloud account via netmaker.

I am using netmaker.io free tier, software on both nodes is identical (Ubuntu 20.04), ports are open, and connection is estabilished.

For the sake of demo I am connected both via WG on port 51820 (subnet 192.168.220.0/24) and Netmaker on standard 51821

From one node to another starting with ping

PING 10.101.0.1 (10.101.0.1) 56(84) bytes of data.
64 bytes from 10.101.0.1: icmp_seq=1 ttl=64 time=24.4 ms
64 bytes from 10.101.0.1: icmp_seq=2 ttl=64 time=37.7 ms
64 bytes from 10.101.0.1: icmp_seq=3 ttl=64 time=59.1 ms
64 bytes from 10.101.0.1: icmp_seq=4 ttl=64 time=12.9 ms
64 bytes from 10.101.0.1: icmp_seq=5 ttl=64 time=39.7 ms
64 bytes from 10.101.0.1: icmp_seq=6 ttl=64 time=74.8 ms
^C
--- 10.101.0.1 ping statistics ---
6 packets transmitted, 6 received, 0% packet loss, time 5007ms
rtt min/avg/max/mdev = 12.912/41.431/74.832/20.612 ms
root@hurma-master-01:/home/ubuntu# ping 192.168.220.1
PING 192.168.220.1 (192.168.220.1) 56(84) bytes of data.
64 bytes from 192.168.220.1: icmp_seq=1 ttl=64 time=1.34 ms
64 bytes from 192.168.220.1: icmp_seq=2 ttl=64 time=1.47 ms
64 bytes from 192.168.220.1: icmp_seq=3 ttl=64 time=1.36 ms
64 bytes from 192.168.220.1: icmp_seq=4 ttl=64 time=1.22 ms
64 bytes from 192.168.220.1: icmp_seq=5 ttl=64 time=2.10 ms

Iperf

iperf3 -c 10.101.0.1
Connecting to host 10.101.0.1, port 5201
[  5] local 10.101.0.4 port 50210 connected to 10.101.0.1 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  38.7 KBytes   317 Kbits/sec    2   1.34 KBytes       
[  5]   1.00-2.00   sec  2.41 MBytes  20.2 Mbits/sec   87    290 KBytes       
[  5]   2.00-3.00   sec  3.56 MBytes  29.8 Mbits/sec  231   74.8 KBytes       
[  5]   3.00-4.00   sec  0.00 Bytes  0.00 bits/sec    3   57.4 KBytes       
[  5]   4.00-5.00   sec  0.00 Bytes  0.00 bits/sec    1   1.34 KBytes       
[  5]   5.00-6.00   sec  0.00 Bytes  0.00 bits/sec    1   1.34 KBytes       
[  5]   6.00-7.00   sec  0.00 Bytes  0.00 bits/sec    0   1.34 KBytes       
[  5]   7.00-8.00   sec  0.00 Bytes  0.00 bits/sec    1   1.34 KBytes       
[  5]   8.00-9.00   sec  0.00 Bytes  0.00 bits/sec    0   1.34 KBytes       
[  5]   9.00-10.01  sec  0.00 Bytes  0.00 bits/sec    0   1.34 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.01  sec  6.01 MBytes  5.03 Mbits/sec  326             sender
[  5]   0.00-10.07  sec  4.37 MBytes  3.64 Mbits/sec                  receiver

 iperf3 -c 192.168.220.1
Connecting to host 192.168.220.1, port 5201
[  5] local 192.168.220.3 port 35906 connected to 192.168.220.1 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   134 MBytes  1.12 Gbits/sec   50    355 KBytes       
[  5]   1.00-2.00   sec   136 MBytes  1.14 Gbits/sec   27    286 KBytes       
[  5]   2.00-3.00   sec   127 MBytes  1.07 Gbits/sec   71    260 KBytes       
[  5]   3.00-4.00   sec   125 MBytes  1.05 Gbits/sec   33    320 KBytes       
[  5]   4.00-5.00   sec   136 MBytes  1.14 Gbits/sec   43    450 KBytes       
[  5]   5.00-6.00   sec   156 MBytes  1.31 Gbits/sec   35    372 KBytes       
[  5]   6.00-7.00   sec   123 MBytes  1.03 Gbits/sec   80    329 KBytes       
[  5]   7.00-8.00   sec   128 MBytes  1.08 Gbits/sec   63    286 KBytes       
[  5]   8.00-9.00   sec   125 MBytes  1.05 Gbits/sec   66    372 KBytes       
[  5]   9.00-10.00  sec   116 MBytes   975 Mbits/sec   33    346 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.28 GBytes  1.10 Gbits/sec  501             sender
[  5]   0.00-10.04  sec  1.27 GBytes  1.09 Gbits/sec                  receiver

Ifconfig


wg0: flags=209<UP,POINTOPOINT,RUNNING,NOARP>  mtu 8920
        inet 192.168.220.3  netmask 255.255.255.0  destination 192.168.220.3
        unspec 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00  txqueuelen 1000  (UNSPEC)
        RX packets 2111543  bytes 726592488 (726.5 MB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 2590355  bytes 3746138408 (3.7 GB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

netmaker: flags=209<UP,POINTOPOINT,RUNNING,NOARP>  mtu 1420
        inet 10.101.0.4  netmask 255.255.0.0  destination 10.101.0.4
        unspec 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00  txqueuelen 1000  (UNSPEC)
        RX packets 705095  bytes 456422168 (456.4 MB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 5927806  bytes 4793696532 (4.7 GB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

Raising MTU of netmaker to the same value as wg (8920) helped with ping but not with iperf

iperf3 -c 10.101.0.1
Connecting to host 10.101.0.1, port 5201
[  5] local 10.101.0.4 port 58238 connected to 10.101.0.1 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   320 KBytes  2.62 Mbits/sec    3   8.66 KBytes       
[  5]   1.00-2.00   sec  0.00 Bytes  0.00 bits/sec    1   8.66 KBytes       
[  5]   2.00-3.00   sec  0.00 Bytes  0.00 bits/sec    0   8.66 KBytes       
[  5]   3.00-4.00   sec  0.00 Bytes  0.00 bits/sec    1   8.66 KBytes       
[  5]   4.00-5.00   sec  0.00 Bytes  0.00 bits/sec    0   8.66 KBytes       
[  5]   5.00-6.00   sec  0.00 Bytes  0.00 bits/sec    0   8.66 KBytes       
[  5]   6.00-7.00   sec  3.48 MBytes  29.2 Mbits/sec   11    104 KBytes       
[  5]   7.00-8.00   sec  2.37 MBytes  19.9 Mbits/sec   10   8.66 KBytes       
[  5]   8.00-9.00   sec  0.00 Bytes  0.00 bits/sec    1   8.66 KBytes       
[  5]   9.00-10.00  sec  0.00 Bytes  0.00 bits/sec    0   8.66 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  6.16 MBytes  5.16 Mbits/sec   27             sender
[  5]   0.00-10.04  sec  5.77 MBytes  4.82 Mbits/sec                  receiver

iperf Done.

Is there anything else I should check?

Version

v0.20.5

What OS are you using?

Linux

Relevant log output

No response

Contributing guidelines

  • [X] Yes, I did.

alekc avatar Aug 06 '23 16:08 alekc