VYOS Proxmox Virtio

General questions
1

Hey All,
We are currently evaluating VYOS on Proxmox / KVM and having a few bandwidth issues. With the virtio ethernet adapters we would normally see 15Gbps intra host (vm-vm) on iperf3. However when testing on vyos we are lucky to see 3Gbps.
vyos@vyos:~$ sudo iperf3 -c 172.17.1.5
Connecting to host 172.17.1.5, port 5201
[ 5] local 172.17.1.8 port 43278 connected to 172.17.1.5 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 303 MBytes 2.55 Gbits/sec 44 1.65 MBytes
[ 5] 1.00-2.00 sec 351 MBytes 2.95 Gbits/sec 40 1.25 MBytes
[ 5] 2.00-3.00 sec 354 MBytes 2.96 Gbits/sec 0 1.43 MBytes
[ 5] 3.00-4.00 sec 348 MBytes 2.92 Gbits/sec 0 1.59 MBytes
[ 5] 4.00-5.00 sec 335 MBytes 2.81 Gbits/sec 7 1.22 MBytes
[ 5] 5.00-6.00 sec 339 MBytes 2.84 Gbits/sec 0 1.41 MBytes
[ 5] 6.00-7.00 sec 338 MBytes 2.83 Gbits/sec 0 1.57 MBytes
[ 5] 7.00-8.00 sec 355 MBytes 2.97 Gbits/sec 0 1.71 MBytes
[ 5] 8.00-9.00 sec 278 MBytes 2.33 Gbits/sec 20 1.30 MBytes
[ 5] 9.00-10.00 sec 329 MBytes 2.76 Gbits/sec 0 1.42 MBytes

[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 3.25 GBytes 2.79 Gbits/sec 111 sender
[ 5] 0.00-10.00 sec 3.25 GBytes 2.79 Gbits/sec receiver

Hardware set up in proxmox below

image
image702×293 44.4 KB

vyos@vyos:~$ show interfaces ethernet eth0 physical
Settings for eth0:
Supported ports: [ ]
Supported link modes: Not reported
Supported pause frame use: No
Supports auto-negotiation: No
Supported FEC modes: Not reported
Advertised link modes: Not reported
Advertised pause frame use: No
Advertised auto-negotiation: No
Advertised FEC modes: Not reported
Speed: 10000Mb/s
Duplex: Full
Port: Other
PHYAD: 0
Transceiver: internal
Auto-negotiation: off
Link detected: yes
driver: virtio_net
version: 1.0.0
firmware-version:
expansion-rom-version:
bus-info: 0000:00:12.0
supports-statistics: yes
supports-test: no
supports-eeprom-access: no
supports-register-dump: no
supports-priv-flags: no

vyos@vyos:~$ show version

Version: VyOS 1.3-rolling-202009100118
Release Train: equuleus

Built by: [email protected]
Built on: Thu 10 Sep 2020 01:18 UTC
Build UUID: 5fcaca09-7cc8-47d4-98a6-9855824a9be6
Build Commit ID: 5fbfd67b1a767b

Architecture: x86_64
Boot via: installed image
System type: KVM guest

Hardware vendor: QEMU
Hardware model: Standard PC (i440FX + PIIX, 1996)
Hardware S/N: Unknown
Hardware UUID: Unknown

Copyright: VyOS maintainers and contributors

Any help would be appreciated as we are very keen to use it in production but would like to see 10Gbps out of it.
I understand SRIOV may work but for some of our applications this is nor feasble.

Thanks

2

Out of interest i have rolled back to an older image 1.2.5 Crux and it works fine. So clearly some issue in the current rolling.
Happy to do more testing if needed.

Thanks

3

Try these options

sudo ethtool -K ethX sg on
sudo ethtool -K ethX gso on
sudo ethtool -K ethX gro on

where ethX - your interface

4

Hey Viacheslav,
Just tried that on a brand new latest rolling and no go, Still the same issues limited to around 2.5Gbps

image
image1091×589 166 KB

5

This topic was automatically closed 2 days after the last reply. New replies are no longer allowed.