I am using ping flood to test various network performance characteristics.
i either have a packetloss problem in my virtual networking or there is an icmp limiter running.
If vyos has some kind of defacto icmp rate limiter, i would like to disable it.
If not, then there is some kind of forwarding problem happening?
can anyone reproduce this or is it just me? can anyone explain this packetloss?
Here’s the layout
centos
10.0.48.1
^
vyos router3
172.16.3.251 (fixed ip)
172.16.3.254 (vrrp floating ip)
10.0.15.251 (fixed ip)
^
vyos router1
10.0.15.253 (fixed ip)
10.0.31.254 (vrrp floating ip)
^
centos
10.0.17.1
traceroute from 10.0.48.1 to 10.0.17.1 (10.0.17.1), 30 hops max, 60 byte packets
1 172.16.3.251 0.308 ms 0.287 ms 0.285 ms
2 10.0.15.253 0.433 ms 0.438 ms 0.468 ms
3 10.0.17.1 0.810 ms 0.805 ms 0.793 ms
traceroute from 10.0.17.1 to 10.0.48.1 (10.0.48.1), 30 hops max, 60 byte packets
1 10.0.15.253 0.225 ms 0.225 ms 0.235 ms
2 10.0.15.251 0.468 ms 0.483 ms 0.495 ms
3 10.0.48.1 0.829 ms 0.835 ms 0.836 ms
vyos@router1# sudo ping -f 10.0.17.1
PING 10.0.17.1 (10.0.17.1) 56(84) bytes of data.
^C
— 10.0.17.1 ping statistics —
13642 packets transmitted, 13642 received, 0% packet loss, time 195ms
rtt min/avg/max/mdev = 0.077/0.110/1.860/0.037 ms, ipg/ewma 0.380/0.129 ms
vyos@router3:~$ sudo ping -f 10.0.17.1
PING 10.0.17.1 (10.0.17.1) 56(84) bytes of data.
…^C
— 10.0.17.1 ping statistics —
3776 packets transmitted, 3489 received, 7.60064% packet loss, time 175ms
rtt min/avg/max/mdev = 0.159/0.270/8.124/0.206 ms, ipg/ewma 1.369/0.306 ms
[root@(10.0.48.1) ~]# ping -f 10.0.17.1
PING 10.0.17.1 (10.0.17.1) 56(84) bytes of data.
…^C
— 10.0.17.1 ping statistics —
2620 packets transmitted, 2230 received, 14.8855% packet loss, time 313ms
rtt min/avg/max/mdev = 0.283/0.469/12.361/0.425 ms, pipe 2, ipg/ewma 2.026/0.412 ms
==== OTHER DIRECTION =======
vyos@router3:~$ sudo ping -f 10.0.48.1
PING 10.0.48.1 (10.0.48.1) 56(84) bytes of data.
^C
— 10.0.48.1 ping statistics —
16634 packets transmitted, 16634 received, 0% packet loss, time 296ms
rtt min/avg/max/mdev = 0.083/0.127/7.701/0.092 ms, ipg/ewma 0.378/0.129 ms
vyos@router1# sudo ping -f 10.0.48.1
PING 10.0.48.1 (10.0.48.1) 56(84) bytes of data.
…^C
— 10.0.48.1 ping statistics —
2900 packets transmitted, 2678 received, 7.65517% packet loss, time 46ms
rtt min/avg/max/mdev = 0.157/0.292/5.056/0.174 ms, ipg/ewma 1.394/0.323 ms
[root@(10.0.17.1) ~]# ping -f 10.0.48.1
PING 10.0.48.1 (10.0.48.1) 56(84) bytes of data.
…^C
— 10.0.48.1 ping statistics —
1690 packets transmitted, 1435 received, 15% packet loss, time 5482ms
rtt min/avg/max/mdev = 0.267/0.504/7.133/0.256 ms, ipg/ewma 3.245/0.496 ms
any brain power spent on this is greatly appreciated.
here’s iperf3
vyos@router1# iperf3 -c 10.0.17.1
Connecting to host 10.0.17.1, port 5201
[ 5] local 10.0.31.254 port 40892 connected to 10.0.17.1 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 432 MBytes 3.62 Gbits/sec 0 325 KBytes
[ 5] 1.00-2.00 sec 431 MBytes 3.62 Gbits/sec 0 341 KBytes
[ 5] 2.00-3.00 sec 412 MBytes 3.46 Gbits/sec 0 359 KBytes
[ 5] 3.00-4.00 sec 406 MBytes 3.41 Gbits/sec 0 390 KBytes
[ 5] 4.00-5.00 sec 424 MBytes 3.55 Gbits/sec 0 430 KBytes
[ 5] 5.00-6.00 sec 422 MBytes 3.54 Gbits/sec 0 430 KBytes
[ 5] 6.00-7.00 sec 424 MBytes 3.55 Gbits/sec 0 448 KBytes
[ 5] 7.00-8.00 sec 416 MBytes 3.49 Gbits/sec 0 502 KBytes
[ 5] 8.00-9.00 sec 425 MBytes 3.57 Gbits/sec 0 502 KBytes
[ 5] 9.00-10.00 sec 408 MBytes 3.42 Gbits/sec 0 525 KBytes
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 4.10 GBytes 3.52 Gbits/sec 0 sender
[ 5] 0.00-10.00 sec 4.10 GBytes 3.52 Gbits/sec receiver
vyos@router3:~$ iperf3 -c 10.0.17.1
Connecting to host 10.0.17.1, port 5201
[ 5] local 10.0.15.251 port 44018 connected to 10.0.17.1 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 199 MBytes 1.67 Gbits/sec 1 1.84 MBytes
[ 5] 1.00-2.00 sec 204 MBytes 1.71 Gbits/sec 0 2.52 MBytes
[ 5] 2.00-3.00 sec 204 MBytes 1.71 Gbits/sec 0 2.52 MBytes
[ 5] 3.00-4.00 sec 195 MBytes 1.64 Gbits/sec 0 2.52 MBytes
[ 5] 4.00-5.00 sec 205 MBytes 1.72 Gbits/sec 0 2.66 MBytes
[ 5] 5.00-6.00 sec 214 MBytes 1.79 Gbits/sec 0 2.92 MBytes
[ 5] 6.00-7.00 sec 205 MBytes 1.72 Gbits/sec 0 2.92 MBytes
[ 5] 7.00-8.00 sec 212 MBytes 1.78 Gbits/sec 0 2.92 MBytes
[ 5] 8.00-9.00 sec 209 MBytes 1.75 Gbits/sec 0 2.92 MBytes
[ 5] 9.00-10.00 sec 214 MBytes 1.79 Gbits/sec 0 3.09 MBytes
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 2.01 GBytes 1.73 Gbits/sec 1 sender
[ 5] 0.00-10.00 sec 2.01 GBytes 1.73 Gbits/sec receiver
[root@privdns1 ~]# iperf3 -c 10.0.17.1
Connecting to host 10.0.17.1, port 5201
[ 5] local 10.0.48.1 port 33766 connected to 10.0.17.1 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 157 MBytes 1.32 Gbits/sec 0 3.01 MBytes
[ 5] 1.00-2.00 sec 148 MBytes 1.24 Gbits/sec 0 3.01 MBytes
[ 5] 2.00-3.00 sec 148 MBytes 1.24 Gbits/sec 0 3.01 MBytes
[ 5] 3.00-4.00 sec 160 MBytes 1.34 Gbits/sec 0 3.01 MBytes
[ 5] 4.00-5.00 sec 158 MBytes 1.32 Gbits/sec 0 3.01 MBytes
[ 5] 5.00-6.00 sec 154 MBytes 1.29 Gbits/sec 0 3.01 MBytes
[ 5] 6.00-7.00 sec 156 MBytes 1.31 Gbits/sec 0 3.01 MBytes
[ 5] 7.00-8.00 sec 151 MBytes 1.27 Gbits/sec 0 3.01 MBytes
[ 5] 8.00-9.00 sec 156 MBytes 1.31 Gbits/sec 0 3.01 MBytes
[ 5] 9.00-10.00 sec 144 MBytes 1.21 Gbits/sec 0 3.01 MBytes
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 1.50 GBytes 1.28 Gbits/sec 0 sender
[ 5] 0.00-10.00 sec 1.49 GBytes 1.28 Gbits/sec receiver
iperf Done.