Proxmox and VyOS unable to get 10G vNIC

General questions
1

Hello,

I am struggling to get 10G networking on VyOS under proxmox.

root@gw-vpn-0-s2s-d6-ds:/home/vyos# lspci
00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] (rev 02)
00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II]
00:01.1 IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]
00:01.2 USB controller: Intel Corporation 82371SB PIIX3 USB [Natoma/Triton II] (rev 01)
00:01.3 Bridge: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 03)
00:02.0 VGA compatible controller: Device 1234:1111 (rev 02)
00:03.0 Unclassified device [00ff]: Red Hat, Inc Virtio memory balloon
00:05.0 SCSI storage controller: Red Hat, Inc Virtio SCSI
00:08.0 Communication controller: Red Hat, Inc Virtio console
00:12.0 Ethernet controller: Red Hat, Inc Virtio network device
00:13.0 Ethernet controller: Red Hat, Inc Virtio network device
00:14.0 Ethernet controller: Red Hat, Inc Virtio network device
00:1e.0 PCI bridge: Red Hat, Inc. QEMU PCI-PCI bridge
00:1f.0 PCI bridge: Red Hat, Inc. QEMU PCI-PCI bridge

Here is another output

vyos@gw-vpn-0-s2s-d6-ds:~$ show interfaces ethernet eth0 physical
Settings for eth0:
        Supported ports: [ ]
        Supported link modes:   Not reported
        Supported pause frame use: No
        Supports auto-negotiation: No
        Supported FEC modes: Not reported
        Advertised link modes:  Not reported
        Advertised pause frame use: No
        Advertised auto-negotiation: No
        Advertised FEC modes: Not reported
        Speed: Unknown!
        Duplex: Unknown! (255)
        Port: Other
        PHYAD: 0
        Transceiver: internal
        Auto-negotiation: off
        Link detected: yes
driver: virtio_net
version: 1.0.0

Also I have tried VMXNET3 as well, but still got 1G link.

Interface changed: [ifDescr] 'VMware VMXNET3 Ethernet Controller' -> 'Red Hat, Inc Device 0001'; [ifDuplex] 'fullDuplex' -> 'unknown'; [ifLastChange] '2020-06-03 22:53:40' -> '2020-06-03 23:31:39'

On VMware I dont have issue with this, easy I have 10G uplink.
How to solve this issue on proxmox ?

2

Hi @rufzor
Perhaps you will help SR-IOV VF
https://pve.proxmox.com/wiki/PCI(e)_Passthrough#_sr_iov

3

dedicated passthrought is not what i am loogking for.
I have vyos as a VM on proxmox, and I want to have 10G.

Is there any bug or something regargind proxmox and vyos, that there is no way to get 10G networking under vNIC ?

4

I have found this. Is there any progress or improvement on this case?
https://phabricator.vyos.net/T600

5

@rufzor Can you try set next commands? Worked with kvm virtio.

ethtool -s eth0 speed 10000 duplex full
show interfaces ethernet eth0 physical
6 
# ethtool -s eth0 speed 10000 duplex full
Cannot set new settings: Operation not supported
  not setting speed
  not setting duplex


# show interfaces ethernet eth0 physical
Settings for eth0:
        Supported ports: [ TP ]
        Supported link modes:   1000baseT/Full 
                                10000baseT/Full 
        Supported pause frame use: No
        Supports auto-negotiation: No
        Supported FEC modes: Not reported
        Advertised link modes:  Not reported
        Advertised pause frame use: No
        Advertised auto-negotiation: No
        Advertised FEC modes: Not reported
        Speed: 1000Mb/s
        Duplex: Full
        Port: Twisted Pair
        PHYAD: 0
        Transceiver: internal
        Auto-negotiation: off
        MDI-X: Unknown
        Supports Wake-on: uag
        Wake-on: d
        Link detected: yes
driver: vmxnet3
version: 1.4.16.0-k-NAPI
firmware-version: 
expansion-rom-version: 
bus-info: 0000:00:12.0
supports-statistics: yes
supports-test: no
supports-eeprom-access: no
supports-register-dump: yes
supports-priv-flags: no
7

I checked virtio drivers and it work fine.
Vmx3 does not work (speed 10000) even on ubuntu 18.04.

DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=18.04
DISTRIB_CODENAME=bionic
DISTRIB_DESCRIPTION="Ubuntu 18.04.4 LTS"
root@openstack:/home/sever# 
root@openstack:/home/sever# ethtool -s ens19 speed 10000 duplex full
Cannot set new settings: Operation not supported
  not setting speed
  not setting duplex

Does it work for you (10G vmxnet3) on any other system in proxmox?
I think this question for proxmox.
From proxmox documentation " * the vmxnet3 is another paravirtualized device, which should only be used when importing a VM from another hypervisor."
ref. https://pve.proxmox.com/wiki/Qemu/KVM_Virtual_Machines

8

I have made some improvment on proxmox, and yeah virtio interface

Then again I have tried to apply ethtool -s eth0 speed 10000 duplex full
and it worked.

So in summary vmxnet got driver issue, I have tried to fix this manualy, and propably I have crased VyOS.
So virtio worked…

There will be another question how to tune RX/TX I/O on proxmox, will be happy times :slight_smile: