I’m trying to figure out what’s causing the poor routing performance I observe in my VyOS VMs.
I have 2 VyOS VMs running on a ESXi 6.7 host.
One VyOS VM is at 1.1.8 and the other is at 1.3.0 rolling latest.
I installed the second one (1.3.0) as an attempt to troubleshoot the routing performance issue I first observed in 1.1.8.
It’s a very simple setup. Both VyOS VMs have 2 network interfaces.
One interface, eth0, is attached to my ‘mgmt’ port group where I have the uplink of my physical server.
The other interface, eth1, is attached to a port group with no uplink and where I have all my VMs.
When I run a iperf between my pc and eth0 (no routing) I get 1 Gb/s which is the max speed of my physical ESXi host network adapter, no problem.
When I run a iperf between my pc and eth1 (routing eth0 <> eth1) I get not more than 350 Mbps, and that I don’t understand.
I played with hardware settings, adding/removing cpu/ram.
I played with hardware offloading settings, enabling/disabling LRO, TSO.
I can’t get anywhere close to 1 Gbps when I route traffic between eth0 and eth1.