VYOS Proxmox Virtio

Hey All,
We are currently evaluating VYOS on Proxmox / KVM and having a few bandwidth issues. With the virtio ethernet adapters we would normally see 15Gbps intra host (vm-vm) on iperf3. However when testing on vyos we are lucky to see 3Gbps.
vyos@vyos:~$ sudo iperf3 -c 172.17.1.5
Connecting to host 172.17.1.5, port 5201
[ 5] local 172.17.1.8 port 43278 connected to 172.17.1.5 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 303 MBytes 2.55 Gbits/sec 44 1.65 MBytes
[ 5] 1.00-2.00 sec 351 MBytes 2.95 Gbits/sec 40 1.25 MBytes
[ 5] 2.00-3.00 sec 354 MBytes 2.96 Gbits/sec 0 1.43 MBytes
[ 5] 3.00-4.00 sec 348 MBytes 2.92 Gbits/sec 0 1.59 MBytes
[ 5] 4.00-5.00 sec 335 MBytes 2.81 Gbits/sec 7 1.22 MBytes
[ 5] 5.00-6.00 sec 339 MBytes 2.84 Gbits/sec 0 1.41 MBytes
[ 5] 6.00-7.00 sec 338 MBytes 2.83 Gbits/sec 0 1.57 MBytes
[ 5] 7.00-8.00 sec 355 MBytes 2.97 Gbits/sec 0 1.71 MBytes
[ 5] 8.00-9.00 sec 278 MBytes 2.33 Gbits/sec 20 1.30 MBytes
[ 5] 9.00-10.00 sec 329 MBytes 2.76 Gbits/sec 0 1.42 MBytes


[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 3.25 GBytes 2.79 Gbits/sec 111 sender
[ 5] 0.00-10.00 sec 3.25 GBytes 2.79 Gbits/sec receiver

Hardware set up in proxmox below

vyos@vyos:~$ show interfaces ethernet eth0 physical
Settings for eth0:
Supported ports: [ ]
Supported link modes: Not reported
Supported pause frame use: No
Supports auto-negotiation: No
Supported FEC modes: Not reported
Advertised link modes: Not reported
Advertised pause frame use: No
Advertised auto-negotiation: No
Advertised FEC modes: Not reported
Speed: 10000Mb/s
Duplex: Full
Port: Other
PHYAD: 0
Transceiver: internal
Auto-negotiation: off
Link detected: yes
driver: virtio_net
version: 1.0.0
firmware-version:
expansion-rom-version:
bus-info: 0000:00:12.0
supports-statistics: yes
supports-test: no
supports-eeprom-access: no
supports-register-dump: no
supports-priv-flags: no

vyos@vyos:~$ show version

Version: VyOS 1.3-rolling-202009100118
Release Train: equuleus

Built by: autobuild@vyos.net
Built on: Thu 10 Sep 2020 01:18 UTC
Build UUID: 5fcaca09-7cc8-47d4-98a6-9855824a9be6
Build Commit ID: 5fbfd67b1a767b

Architecture: x86_64
Boot via: installed image
System type: KVM guest

Hardware vendor: QEMU
Hardware model: Standard PC (i440FX + PIIX, 1996)
Hardware S/N: Unknown
Hardware UUID: Unknown

Copyright: VyOS maintainers and contributors

Any help would be appreciated as we are very keen to use it in production but would like to see 10Gbps out of it.
I understand SRIOV may work but for some of our applications this is nor feasble.

Thanks

Out of interest i have rolled back to an older image 1.2.5 Crux and it works fine. So clearly some issue in the current rolling.
Happy to do more testing if needed.

Thanks

Try these options

sudo ethtool -K ethX sg on
sudo ethtool -K ethX gso on
sudo ethtool -K ethX gro on

where ethX - your interface

Hey Viacheslav,
Just tried that on a brand new latest rolling and no go, Still the same issues limited to around 2.5Gbps

This topic was automatically closed 2 days after the last reply. New replies are no longer allowed.