Recommended Network Configuration

[himurae]

hello guys please share based on your experiences the best tweaks you have found which improves overall performance ,speed ,i run on a bare metal box ,any useful packages you found must have…

[Apachez]

Your mileage may vary but things to examine and test:

Note that for some of the changes you need to reboot for them to have affect.

set interfaces ethernet ethX offload gro
set interfaces ethernet ethX offload gso
set interfaces ethernet ethX offload lro
set interfaces ethernet ethX offload rfs
set interfaces ethernet ethX offload rps
set interfaces ethernet ethX offload sg
set interfaces ethernet ethX offload tso
set interfaces ethernet ethX ring-buffer rx '4096'
set interfaces ethernet ethX ring-buffer tx '4096'

set system conntrack expect-table-size '10485760'
set system conntrack hash-size '10485760'
set system conntrack table-size '10485760'

set system ip arp table-size '32768'
set system ip multipath layer4-hashing
set system ipv6 multipath layer4-hashing
set system ipv6 neighbor table-size '32768'

set system option performance 'throughput'

And to use BBR as congestion control:

set system sysctl parameter net.core.default_qdisc value 'fq'
set system sysctl parameter net.ipv4.tcp_congestion_control value 'bbr'

Along with adding following to /config/scripts/vyos-preconfig-bootup.script:

/sbin/modprobe tcp_bbr

Also keep an eye for when software-offloading for the firewall through flowtable will get merged (and after that hardware-offloading using flowtable):

set firewall global-options offload flowtable ...

See ⚓ T5419 Software/Hardware fastpath with nftables flowtable among other tasks on similar feature.

[himurae]

Let me try and report by the way couple of days ago i tried set system option performance ‘throughput’ but even after restart it noticeably reduced my speed test i am on 1.3.3 iso

[Apachez]

Yeah, the above is from current 1.4-rolling so not all will be available for 1.3 series.

[himurae]

Any updates to this post @Apachez