Hi Team,
This is my topology and trying to achieve link failure at between R1 ↔ R3. R1/R2 are in cluster and that is working fine. However if I shut the eth0 (10.10.11.15) on R1 traffic does not failover.
Here is my config
R1
set cluster dead-interval '20000'
set cluster group clus auto-failback 'true'
set cluster group clus primary 'BLR-R1'
set cluster group clus secondary 'BLR-R2'
set cluster group clus service '10.10.11.15/24/eth0'
set cluster group clus service '10.10.12.15/24/eth1'
set cluster group clus service '10.10.14.15/24/eth3'
set cluster interface 'eth2'
set cluster keepalive-interval '5000'
set cluster monitor-dead-interval '20000'
set cluster pre-shared-secret 'admin@123'
set interfaces dummy dum10 address '10.144.144.1/32'
set interfaces dummy dum10 ip ospf bfd
set interfaces dummy dum10 ip ospf dead-interval '40'
set interfaces dummy dum10 ip ospf hello-interval '10'
set interfaces dummy dum10 ip ospf priority '1'
set interfaces dummy dum10 ip ospf retransmit-interval '5'
set interfaces dummy dum10 ip ospf transmit-delay '1'
set interfaces ethernet eth0 address '10.10.11.15/24'
set interfaces ethernet eth1 address '10.10.12.15/24'
set interfaces ethernet eth2 address '10.10.17.15/24'
set interfaces ethernet eth3 address '10.10.14.15/24'
set interfaces wireguard wg10 address '169.254.1.1/30'
set interfaces wireguard wg10 ip ospf cost '5'
set interfaces wireguard wg10 ip ospf dead-interval '40'
set interfaces wireguard wg10 ip ospf hello-interval '10'
set interfaces wireguard wg10 ip ospf priority '1'
set interfaces wireguard wg10 ip ospf retransmit-interval '5'
set interfaces wireguard wg10 ip ospf transmit-delay '1'
set interfaces wireguard wg10 peer to_peer allowed-ips '0.0.0.0/0'
set interfaces wireguard wg10 peer to_peer persistent-keepalive '2'
set interfaces wireguard wg10 peer to_peer pubkey '1yfIhIhKiPCM+QD75nDR8x0dLE3O4xEyYoRhWgd1wCo='
set interfaces wireguard wg10 port '16578'
set interfaces wireguard wg10 private-key 'default'
set interfaces wireguard wg20 address '169.254.1.5/30'
set interfaces wireguard wg20 ip ospf bfd
set interfaces wireguard wg20 ip ospf cost '10'
set interfaces wireguard wg20 ip ospf dead-interval '10'
set interfaces wireguard wg20 ip ospf hello-interval '5'
set interfaces wireguard wg20 ip ospf priority '1'
set interfaces wireguard wg20 ip ospf retransmit-interval '5'
set interfaces wireguard wg20 ip ospf transmit-delay '1'
set interfaces wireguard wg20 peer to_peer allowed-ips '0.0.0.0/0'
set interfaces wireguard wg20 peer to_peer persistent-keepalive '2'
set interfaces wireguard wg20 peer to_peer pubkey '1yfIhIhKiPCM+QD75nDR8x0dLE3O4xEyYoRhWgd1wCo='
set interfaces wireguard wg20 port '16579'
set interfaces wireguard wg20 private-key 'default'
set protocols bfd peer 10.144.144.2 source address '10.144.144.1'
set protocols bgp 65500 address-family ipv4-unicast network 10.10.12.0/24
set protocols bgp 65500 address-family ipv4-unicast redistribute static
set protocols bgp 65500 neighbor 10.144.144.2 address-family ipv4-unicast nexthop-self
set protocols bgp 65500 neighbor 10.144.144.2 address-family ipv4-unicast soft-reconfiguration inbound
set protocols bgp 65500 neighbor 10.144.144.2 remote-as '65500'
set protocols bgp 65500 neighbor 10.144.144.2 update-source '10.144.144.1'
set protocols ospf area 0 network '10.144.144.1/32'
set protocols ospf area 0 network '169.254.1.0/30'
set protocols ospf area 0 network '169.254.1.4/30'
set protocols ospf parameters abr-type 'cisco'
set protocols ospf parameters router-id '10.144.144.1'
Here is R3
set interfaces dummy dum20 address '10.144.144.2/32'
set interfaces dummy dum20 ip ospf bfd
set interfaces dummy dum20 ip ospf dead-interval '40'
set interfaces dummy dum20 ip ospf hello-interval '10'
set interfaces dummy dum20 ip ospf priority '1'
set interfaces dummy dum20 ip ospf retransmit-interval '5'
set interfaces dummy dum20 ip ospf transmit-delay '1'
set interfaces ethernet eth0 address '10.10.11.35/24'
set interfaces ethernet eth0 hw-id '00:0c:29:c1:ef:d8'
set interfaces ethernet eth1 address '10.10.13.35/24'
set interfaces ethernet eth1 hw-id '00:0c:29:c1:ef:e2'
set interfaces ethernet eth2 address '10.10.14.35/24'
set interfaces ethernet eth2 hw-id '00:0c:29:c1:ef:ec'
set interfaces wireguard wg10 address '169.254.1.2/30'
set interfaces wireguard wg10 ip ospf cost '5'
set interfaces wireguard wg10 ip ospf dead-interval '40'
set interfaces wireguard wg10 ip ospf hello-interval '10'
set interfaces wireguard wg10 ip ospf priority '1'
set interfaces wireguard wg10 ip ospf retransmit-interval '5'
set interfaces wireguard wg10 ip ospf transmit-delay '1'
set interfaces wireguard wg10 peer to_ho address '10.10.11.15'
set interfaces wireguard wg10 peer to_ho allowed-ips '0.0.0.0/0'
set interfaces wireguard wg10 peer to_ho persistent-keepalive '2'
set interfaces wireguard wg10 peer to_ho port '16578'
set interfaces wireguard wg10 peer to_ho pubkey 'wFPcpkbHSG3lB/9RVzfzHuRt2RUMxv9DoWzKjhWftQA='
set interfaces wireguard wg10 private-key 'default'
set interfaces wireguard wg20 address '169.254.1.6/30'
set interfaces wireguard wg20 ip ospf cost '10'
set interfaces wireguard wg20 ip ospf dead-interval '40'
set interfaces wireguard wg20 ip ospf hello-interval '10'
set interfaces wireguard wg20 ip ospf priority '1'
set interfaces wireguard wg20 ip ospf retransmit-interval '5'
set interfaces wireguard wg20 ip ospf transmit-delay '1'
set interfaces wireguard wg20 peer to_ho address '10.10.14.15'
set interfaces wireguard wg20 peer to_ho allowed-ips '0.0.0.0/0'
set interfaces wireguard wg20 peer to_ho persistent-keepalive '2'
set interfaces wireguard wg20 peer to_ho port '16579'
set interfaces wireguard wg20 peer to_ho pubkey 'wFPcpkbHSG3lB/9RVzfzHuRt2RUMxv9DoWzKjhWftQA='
set interfaces wireguard wg20 private-key 'default'
set protocols bfd peer 10.144.144.1 source address '10.144.144.2'
set protocols bgp 65500 address-family ipv4-unicast network 10.10.13.0/24
set protocols bgp 65500 address-family ipv4-unicast redistribute static
set protocols bgp 65500 neighbor 10.144.144.1 address-family ipv4-unicast nexthop-self
set protocols bgp 65500 neighbor 10.144.144.1 address-family ipv4-unicast soft-reconfiguration inbound
set protocols bgp 65500 neighbor 10.144.144.1 remote-as '65500'
set protocols bgp 65500 neighbor 10.144.144.1 update-source '10.144.144.2'
set protocols ospf area 0 network '169.254.1.0/30'
set protocols ospf area 0 network '169.254.1.4/30'
set protocols ospf area 0 network '10.144.144.2/32'
set protocols ospf parameters abr-type 'cisco'
set protocols ospf parameters router-id '10.144.144.2'
OSPF and BGP from R1
Interface IP Address S/L Description
--------- ---------- --- -----------
dum10 10.144.144.1/32 u/u
eth0 10.10.11.15/24 u/u
eth1 10.10.12.15/24 u/u
eth2 10.10.17.15/24 u/u
eth3 10.10.14.15/24 u/u
lo 127.0.0.1/8 u/u
::1/128
wg10 169.254.1.1/30 u/u
wg20 169.254.1.5/30 u/u
vyos@BLR-R1# run show ip ospf neighbor
Neighbor ID Pri State Dead Time Address Interface RXmtL RqstL DBsmL
10.144.144.2 1 Full/DROther 37.512s 169.254.1.2 wg10:169.254.1.1 0 0 0
[edit]
vyos@BLR-R1# run show ip ospf route
============ OSPF network routing table ============
N 10.144.144.1/32 [10] area: 0.0.0.0
directly attached to dum10
N 10.144.144.2/32 [15] area: 0.0.0.0
via 169.254.1.2, wg10
N 169.254.1.0/30 [5] area: 0.0.0.0
directly attached to wg10
N 169.254.1.4/30 [10] area: 0.0.0.0
directly attached to wg20
============ OSPF router routing table =============
============ OSPF external routing table ===========
[edit]
vyos@BLR-R1# run show ip bgp summary
IPv4 Unicast Summary:
BGP router identifier 10.144.144.1, local AS number 65500 vrf-id 0
BGP table version 6
RIB entries 3, using 576 bytes of memory
Peers 1, using 21 KiB of memory
Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd PfxSnt
10.144.144.2 4 65500 72 81 0 0 0 00:42:21 1 1
Total number of neighbors 1
[edit]
vyos@BLR-R1# run show ip bgp
BGP table version is 6, local router ID is 10.144.144.1, vrf id 0
Default local pref 100, local AS 65500
Status codes: s suppressed, d damped, h history, * valid, > best, = multipath,
i internal, r RIB-failure, S Stale, R Removed
Nexthop codes: @NNN nexthop's vrf id, < announce-nh-self
Origin codes: i - IGP, e - EGP, ? - incomplete
Network Next Hop Metric LocPrf Weight Path
*> 10.10.12.0/24 0.0.0.0 0 32768 i
*>i10.10.13.0/24 10.144.144.2 0 100 0 i
Displayed 2 routes and 2 total paths
[edit]
And from R3
--------- ---------- --- -----------
dum20 10.144.144.2/32 u/u
eth0 10.10.11.35/24 u/u
eth1 10.10.13.35/24 u/u
eth2 10.10.14.35/24 u/u
lo 127.0.0.1/8 u/u
::1/128
wg10 169.254.1.2/30 u/u
wg20 169.254.1.6/30 u/u
vyos@BLR-R3:~$ show ip ospf route
============ OSPF network routing table ============
N 10.144.144.1/32 [15] area: 0.0.0.0
via 169.254.1.1, wg10
N 10.144.144.2/32 [10] area: 0.0.0.0
directly attached to dum20
N 169.254.1.0/30 [5] area: 0.0.0.0
directly attached to wg10
N 169.254.1.4/30 [10] area: 0.0.0.0
directly attached to wg20
============ OSPF router routing table =============
============ OSPF external routing table ===========
vyos@BLR-R3:~$ show ip ospf neighbor
Neighbor ID Pri State Dead Time Address Interface RXmtL RqstL DBsmL
10.144.144.1 1 Full/DROther 31.853s 169.254.1.1 wg10:169.254.1.2 0 0 0
vyos@BLR-R3:~$ show ip bgp summary
IPv4 Unicast Summary:
BGP router identifier 10.144.144.2, local AS number 65500 vrf-id 0
BGP table version 6
RIB entries 3, using 576 bytes of memory
Peers 1, using 21 KiB of memory
Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd PfxSnt
10.144.144.1 4 65500 73 78 0 0 0 00:44:22 1 1
Total number of neighbors 1
vyos@BLR-R3:~$ show ip bgp
BGP table version is 6, local router ID is 10.144.144.2, vrf id 0
Default local pref 100, local AS 65500
Status codes: s suppressed, d damped, h history, * valid, > best, = multipath,
i internal, r RIB-failure, S Stale, R Removed
Nexthop codes: @NNN nexthop's vrf id, < announce-nh-self
Origin codes: i - IGP, e - EGP, ? - incomplete
Network Next Hop Metric LocPrf Weight Path
*>i10.10.12.0/24 10.144.144.1 0 100 0 i
*> 10.10.13.0/24 0.0.0.0 0 32768 i
Displayed 2 routes and 2 total paths
vyos@BLR-R3:~$
What dummy interfaces are not being seen from both the links?