I have two dell servers with the x710 4 port 10gb cards
One running this seems to work fine, unfortunately I don’t have another copy of this version, can’t find a download link, or how I could copy a live image or I would mirror them.
Version: VyOS 1.4-rolling-202101301326
Release Train: sagitta
Built by: autobuild@vyos.net
Built on: Sat 30 Jan 2021 13:26 UTC
Build UUID: 3f93aff0-39a4-405f-bcd3-c059181e7ba8
Build Commit ID: 37b270bab20d9f
Architecture: x86_64
Boot via: installed image
System type: bare metal
Hardware vendor: Dell Inc.
Hardware model: PowerEdge R610
Hardware S/N: 4S5T4K1
Hardware UUID: 4c4c4544-0053-3510-8054-b4c04f344b31
Copyright: VyOS maintainers and contributors
ethtool -i eth7
driver: i40e
version: 5.10.10-amd64-vyos
firmware-version: 4.25 0x800014cc 0.0.0
expansion-rom-version:
bus-info: 0000:04:00.3
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes
The other server was having ntpd buffer errors, then I discovered this in the log.
eb 16 18:44:56 endeavor kernel: [ 657.234688] i40e 0000:04:00.3 eth7: tx_timeout: VSI_seid: 525, Q 1, NTC: 0x89, HWB: 0x89, NTU: 0x97, TAIL: 0x97, INT: 0x1
Feb 16 18:44:56 endeavor kernel: [ 657.234700] i40e 0000:04:00.3 eth7: tx_timeout recovery level 1, txqueue 1
which led me down the path of research on the i40e and a lot of issues over the years, so I opted to update the firmware to the latest intel version, I completed that process and it seemed like it was working… It was working until it was under load, at about 370mbps the remote side says they see the link flapping, there is nothing in the local logs and I can’t see it flap. This is a live network so if I test I cause impairment. Any assistance would be great.
Here is the other data.
Version: VyOS 1.4-rolling-202202080317
Release train: sagitta
Built by: autobuild@vyos.net
Built on: Tue 08 Feb 2022 03:17 UTC
Build UUID: 3ca778de-e090-4c59-b7b1-62dbab5c820d
Build commit ID: db3571d7b18c04
Architecture: x86_64
Boot via: installed image
System type: bare metal
Hardware vendor: Dell Inc.
Hardware model: PowerEdge R610
Hardware S/N: 348SVH1
Hardware UUID: 4c4c4544-0034-3810-8053-b3c04f564831
Copyright: VyOS maintainers and contributors
driver: i40e
version: 5.10.96-amd64-vyos
firmware-version: 8.40 0x8000abdf 1.2992.0
expansion-rom-version:
bus-info: 0000:04:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes
set firewall all-ping ‘enable’
set firewall broadcast-ping ‘disable’
set firewall config-trap ‘disable’
set firewall group network-group CSS-ACCESS network ‘xxx.xxx.47.0/24’
set firewall group network-group CSS-ACCESS network ‘xxx.xxx.43.0/24’
set firewall group network-group CSS-ACCESS network ‘xxx.xxx.0.0/16’
set firewall group network-group CSS-ACCESS network ‘xxx.xxx.116.243/32’
set firewall group network-group CSS-ACCESS network ‘xxx.xxx.170.0/24’
set firewall ipv6-receive-redirects ‘disable’
set firewall ipv6-src-route ‘disable’
set firewall ip-src-route ‘disable’
set firewall log-martians ‘enable’
set firewall name AllowSSH default-action ‘accept’
set firewall name AllowSSH rule 10 action ‘accept’
set firewall name AllowSSH rule 10 description ‘‘AllowCSS’’
set firewall name AllowSSH rule 10 destination address ‘xxx.xxx.48.193’
set firewall name AllowSSH rule 10 destination port ‘22’
set firewall name AllowSSH rule 10 protocol ‘tcp’
set firewall name AllowSSH rule 10 source group network-group ‘CSS-ACCESS’
set firewall name AllowSSH rule 10 state established ‘enable’
set firewall name AllowSSH rule 10 state new ‘enable’
set firewall name AllowSSH rule 10 state related ‘enable’
set firewall name AllowSSH rule 20 action ‘drop’
set firewall name AllowSSH rule 20 description ‘Drop-ssh-access’
set firewall name AllowSSH rule 20 destination address ‘xxx.xxx.48.193’
set firewall name AllowSSH rule 20 destination port ‘22’
set firewall name AllowSSH rule 20 protocol ‘tcp’
set firewall receive-redirects ‘disable’
set firewall send-redirects ‘disable’
set firewall source-validation ‘disable’
set firewall syn-cookies ‘enable’
set firewall twa-hazards-protection ‘disable’
set interfaces ethernet eth0 address ‘dhcp’
set interfaces ethernet eth0 description ‘LanInterface’
set interfaces ethernet eth0 disable
set interfaces ethernet eth0 duplex ‘auto’
set interfaces ethernet eth0 hw-id ‘xx:xx:xx:xx:xx:64’
set interfaces ethernet eth0 offload gro
set interfaces ethernet eth0 offload gso
set interfaces ethernet eth0 offload sg
set interfaces ethernet eth0 offload tso
set interfaces ethernet eth0 speed ‘auto’
set interfaces ethernet eth1 address ‘xxx.xxx.154.38/30’
set interfaces ethernet eth1 description ‘Transit: Wave 11/WDIA/042265/’
set interfaces ethernet eth1 disable
set interfaces ethernet eth1 duplex ‘auto’
set interfaces ethernet eth1 hw-id ‘xx:xx:xx:xx:xx:66’
set interfaces ethernet eth1 offload gro
set interfaces ethernet eth1 offload gso
set interfaces ethernet eth1 offload sg
set interfaces ethernet eth1 offload tso
set interfaces ethernet eth1 speed ‘auto’
set interfaces ethernet eth2 address ‘xxx.xxx.48.234/30’
set interfaces ethernet eth2 description ‘Secondary-OSPF-Resolute’
set interfaces ethernet eth2 disable
set interfaces ethernet eth2 duplex ‘auto’
set interfaces ethernet eth2 hw-id ‘xx:xx:xx:xx:xx:68’
set interfaces ethernet eth2 offload gro
set interfaces ethernet eth2 offload gso
set interfaces ethernet eth2 offload sg
set interfaces ethernet eth2 offload tso
set interfaces ethernet eth2 speed ‘auto’
set interfaces ethernet eth3 disable
set interfaces ethernet eth3 duplex ‘auto’
set interfaces ethernet eth3 hw-id ‘xx:xx:xx:xx:xx:6a’
set interfaces ethernet eth3 offload gro
set interfaces ethernet eth3 offload gso
set interfaces ethernet eth3 offload sg
set interfaces ethernet eth3 offload tso
set interfaces ethernet eth3 speed ‘auto’
set interfaces ethernet eth4 address ‘xxx.xxx.160.162/30’
set interfaces ethernet eth4 address ‘xxxx:xxxx:200:21::1d/127’
set interfaces ethernet eth4 description ‘Transit: Wave 11/WDIA/042265/ 10gb’
set interfaces ethernet eth4 disable-flow-control
set interfaces ethernet eth4 duplex ‘auto’
set interfaces ethernet eth4 hw-id ‘xx:xx:xx:xx:xx:c0’
set interfaces ethernet eth4 offload gro
set interfaces ethernet eth4 offload gso
set interfaces ethernet eth4 offload sg
set interfaces ethernet eth4 offload tso
set interfaces ethernet eth4 speed ‘auto’
set interfaces ethernet eth5 disable
set interfaces ethernet eth5 duplex ‘auto’
set interfaces ethernet eth5 hw-id ‘xx:xx:xx:xx:xx:c1’
set interfaces ethernet eth5 offload gro
set interfaces ethernet eth5 offload gso
set interfaces ethernet eth5 offload sg
set interfaces ethernet eth5 offload tso
set interfaces ethernet eth5 speed ‘auto’
set interfaces ethernet eth6 disable
set interfaces ethernet eth6 duplex ‘auto’
set interfaces ethernet eth6 hw-id ‘xx:xx:xx:xx:xx:c2’
set interfaces ethernet eth6 offload gro
set interfaces ethernet eth6 offload gso
set interfaces ethernet eth6 offload sg
set interfaces ethernet eth6 offload tso
set interfaces ethernet eth6 speed ‘auto’
set interfaces ethernet eth7 address ‘xxx.xxx.48.193/29’
set interfaces ethernet eth7 address ‘xxxx:xxxx:48:192::193/64’
set interfaces ethernet eth7 description ‘CSS-BGP-OSPF-10G’
set interfaces ethernet eth7 disable-flow-control
set interfaces ethernet eth7 duplex ‘auto’
set interfaces ethernet eth7 firewall local name ‘AllowSSH’
set interfaces ethernet eth7 hw-id ‘xx:xx:xx:xx:xx:c3’
set interfaces ethernet eth7 offload gro
set interfaces ethernet eth7 offload gso
set interfaces ethernet eth7 offload sg
set interfaces ethernet eth7 offload tso
set interfaces ethernet eth7 speed ‘auto’
set interfaces ethernet eth8 disable
set interfaces ethernet eth8 duplex ‘auto’
set interfaces ethernet eth8 hw-id ‘xx:xx:xx:xx:xx:69’
set interfaces ethernet eth8 offload gro
set interfaces ethernet eth8 offload gso
set interfaces ethernet eth8 offload sg
set interfaces ethernet eth8 offload tso
set interfaces ethernet eth8 speed ‘auto’
set interfaces ethernet eth9 disable
set interfaces ethernet eth9 duplex ‘auto’
set interfaces ethernet eth9 hw-id ‘xx:xx:xx:xx:xx:68’
set interfaces ethernet eth9 offload gro
set interfaces ethernet eth9 offload gso
set interfaces ethernet eth9 offload sg
set interfaces ethernet eth9 offload tso
set interfaces ethernet eth9 speed ‘auto’
set interfaces loopback lo address ‘xxx.xxx.48.250/32’
set policy as-path-list AllRoutes rule 5 action ‘permit’
set policy as-path-list AllRoutes rule 5 description ‘All BGP Routes’
set policy as-path-list AllRoutes rule 5 regex ‘.*’
set policy as-path-list CSS-OUT rule 1 action ‘permit’
set policy as-path-list CSS-OUT rule 1 description ‘CSS 32.0/19 Routes’
set policy as-path-list CSS-OUT rule 1 regex ‘^$’
set policy as-path-list CSSRoutes rule 10 action ‘permit’
set policy as-path-list CSSRoutes rule 10 description ‘CSS BGP Routes’
set policy as-path-list CSSRoutes rule 10 regex ‘^$’
set policy community-list 10 rule 10 action ‘permit’
set policy community-list 10 rule 10 regex ‘65332:888’
set policy prefix-list Cymru-OutRoutes-ipv4 rule 10 action ‘deny’
set policy prefix-list Cymru-OutRoutes-ipv4 rule 10 le ‘32’
set policy prefix-list Cymru-OutRoutes-ipv4 rule 10 prefix ‘xxx.xxx.0.0/0’
set policy prefix-list6 Cymru-OutRoutes-ipv6 rule 10 action ‘deny’
set policy prefix-list6 Cymru-OutRoutes-ipv6 rule 10 le ‘128’
set policy prefix-list6 Cymru-OutRoutes-ipv6 rule 10 prefix ‘::/0’
set policy route-map AllRoutes rule 15 action ‘permit’
set policy route-map AllRoutes rule 15 match as-path ‘AllRoutes’
set policy route-map CSSOut rule 10 action ‘permit’
set policy route-map CSSOut rule 10 match as-path ‘CSS-OUT’
set policy route-map CSSOut rule 10 set as-path-prepend ‘26792’
set policy route-map CymruBogons-ip4-REC rule 10 action ‘permit’
set policy route-map CymruBogons-ip4-REC rule 10 description ‘Blackhole IPv4 Routes Received from Cymru’
set policy route-map CymruBogons-ip4-REC rule 10 match community community-list ‘10’
set policy route-map CymruBogons-ip4-REC rule 10 set ip-next-hop ‘xxx.xxx.2.1’
set policy route-map CymruBogons-ip6-REC rule 10 action ‘permit’
set policy route-map CymruBogons-ip6-REC rule 10 description ‘Blackhole IPv6 Routes Received from Cymru’
set policy route-map CymruBogons-ip6-REC rule 10 match community community-list ‘10’
set policy route-map CymruBogons-ip6-REC rule 10 set ipv6-next-hop global ‘xxxx:xxxx:0:DEAD:BEEF::1’
set protocols bgp address-family ipv4-unicast network xxx.xxx.32.0/19
set protocols bgp address-family ipv6-unicast network xxxx:xxxx::/32
set protocols bgp local-as ‘26792’
set protocols bgp neighbor xxx.xxx.6.20 address-family ipv4-unicast prefix-list export ‘Cymru-OutRoutes-ipv4’
set protocols bgp neighbor xxx.xxx.6.20 address-family ipv4-unicast route-map import ‘CymruBogons-ip4-REC’
set protocols bgp neighbor xxx.xxx.6.20 address-family ipv4-unicast soft-reconfiguration inbound
set protocols bgp neighbor xxx.xxx.6.20 address-family ipv6-unicast prefix-list export ‘Cymru-OutRoutes-ipv6’
set protocols bgp neighbor xxx.xxx.6.20 address-family ipv6-unicast route-map import ‘CymruBogons-ip6-REC’
set protocols bgp neighbor xxx.xxx.6.20 address-family ipv6-unicast soft-reconfiguration inbound
set protocols bgp neighbor xxx.xxx.6.20 description ‘CYMRU-BGP-Bogon-Routes’
set protocols bgp neighbor xxx.xxx.6.20 ebgp-multihop ‘255’
set protocols bgp neighbor xxx.xxx.6.20 password xxxxxx
set protocols bgp neighbor xxx.xxx.6.20 remote-as ‘65332’
set protocols bgp neighbor xxx.xxx.6.20 update-source ‘lo’
set protocols bgp neighbor xxx.xxx.46.20 address-family ipv4-unicast prefix-list export ‘Cymru-OutRoutes-ipv4’
set protocols bgp neighbor xxx.xxx.46.20 address-family ipv4-unicast route-map import ‘CymruBogons-ip4-REC’
set protocols bgp neighbor xxx.xxx.46.20 address-family ipv4-unicast soft-reconfiguration inbound
set protocols bgp neighbor xxx.xxx.46.20 address-family ipv6-unicast prefix-list export ‘Cymru-OutRoutes-ipv6’
set protocols bgp neighbor xxx.xxx.46.20 address-family ipv6-unicast route-map import ‘CymruBogons-ip6-REC’
set protocols bgp neighbor xxx.xxx.46.20 address-family ipv6-unicast soft-reconfiguration inbound
set protocols bgp neighbor xxx.xxx.46.20 description ‘CYMRU-BGP-Bogon-Routes’
set protocols bgp neighbor xxx.xxx.46.20 ebgp-multihop ‘255’
set protocols bgp neighbor xxx.xxx.46.20 password xxxxxx
set protocols bgp neighbor xxx.xxx.46.20 remote-as ‘65332’
set protocols bgp neighbor xxx.xxx.46.20 update-source ‘lo’
set protocols bgp neighbor xxx.xxx.47.242 address-family ipv4-unicast route-map export ‘CSSOut’
set protocols bgp neighbor xxx.xxx.47.242 address-family ipv4-unicast route-map import ‘AllRoutes’
set protocols bgp neighbor xxx.xxx.47.242 description ‘Endeavor’
set protocols bgp neighbor xxx.xxx.47.242 remote-as ‘26792’
set protocols bgp neighbor xxx.xxx.47.242 update-source ‘lo’
set protocols bgp neighbor xxx.xxx.48.251 address-family ipv4-unicast route-map export ‘CSSOut’
set protocols bgp neighbor xxx.xxx.48.251 description ‘BGPB-Six’
set protocols bgp neighbor xxx.xxx.48.251 peer-group ‘css’
set protocols bgp neighbor xxx.xxx.160.161 address-family ipv4-unicast route-map export ‘CSSOut’
set protocols bgp neighbor xxx.xxx.160.161 address-family ipv4-unicast route-map import ‘AllRoutes’
set protocols bgp neighbor xxx.xxx.160.161 description ‘Wave-Astound’
set protocols bgp neighbor xxx.xxx.160.161 remote-as ‘11404’
set protocols bgp neighbor xxx.xxx.160.161 shutdown
set protocols bgp neighbor xxx.xxx.160.161 update-source ‘lo’
set protocols bgp neighbor xxx.xxx.154.37 address-family ipv4-unicast route-map export ‘CSSOut’
set protocols bgp neighbor xxx.xxx.154.37 address-family ipv4-unicast route-map import ‘AllRoutes’
set protocols bgp neighbor xxx.xxx.154.37 description ‘Wave-Astound’
set protocols bgp neighbor xxx.xxx.154.37 remote-as ‘11404’
set protocols bgp neighbor xxx.xxx.154.37 shutdown
set protocols bgp neighbor xxx.xxx.154.37 update-source ‘lo’
set protocols bgp neighbor xxxx:xxxx:200:21::1c remote-as ‘11404’
set protocols bgp parameters router-id ‘xxx.xxx.48.250’
set protocols bgp peer-group css remote-as ‘26792’
set protocols bgp peer-group css update-source ‘lo’
set protocols ospf area xxx.xxx.0.0 network ‘xxx.xxx.48.192/29’
set protocols ospf area xxx.xxx.0.0 network ‘xxx.xxx.48.232/30’
set protocols ospf default-information originate metric-type ‘2’
set protocols ospf parameters abr-type ‘cisco’
set protocols ospf parameters router-id ‘xxx.xxx.48.250’
set protocols ospf redistribute connected metric-type ‘2’
set protocols ospf redistribute static
set protocols static route xxx.xxx.0.0/0 next-hop xxx.xxx.160.161 distance ‘240’
set protocols static route xxx.xxx.32.0/19 blackhole distance ‘254’
set protocols static route xxx.xxx.2.1/32 blackhole distance ‘255’
set protocols static route6 xxxx:xxxx:0:DEAD:BEEF::1/128 blackhole distance ‘255’
set service snmp community cssstats authorization ‘ro’
set service snmp community cssstats network ‘xxx.xxx.43.0/24’
set service snmp contact ‘support@cssnw.com’
set service snmp listen-address xxx.xxx.48.250
set service snmp location xxxxxx
set service ssh listen-address ‘xxx.xxx.170.171’
set service ssh listen-address ‘xxx.xxx.48.193’
set service ssh port ‘22’
set system config-management commit-revisions ‘100’
set system conntrack modules ftp
set system conntrack modules h323
set system conntrack modules nfs
set system conntrack modules pptp
set system conntrack modules sip
set system conntrack modules sqlnet
set system conntrack modules tftp
set system console device ttyS0 speed ‘9600’
set system domain-name xxxxxx
set system host-name xxxxxx
set system login user xxxxxx authentication encrypted-password xxxxxx
set system login user xxxxxx authentication plaintext-password xxxxxx
set system login user xxxxxx authentication public-keys xxxx@xxx.xxx key xxxxxx
set system login user xxxxxx authentication public-keys xxxx@xxx.xxx type ssh-xxx
set system name-server ‘xxx.xxx.47.10’
set system name-server ‘xxx.xxx.43.10’
set system name-server ‘eth0’
set system ntp server xxxxx.tld
set system ntp server xxxxx.tld
set system ntp server xxxxx.tld
set system syslog global facility all level ‘info’
set system syslog global facility protocols level ‘debug’
set system time-zone ‘America/Vancouver’