BGP VRF labels pool

General questions
,
1

Hi,
I’m trying to deploy VYOS that suppose to be terminating many VRFs, basically > 255 VRFs.
I’m using ‘label vpn export auto’ for each VRF and verifying this I see VYOS label pool supports only 128 VRFs (labels 80-207).
Also when deleting one VRF that has a label assigned already, VYOS doesn’t re-use this label for other VRFs that doesn’t have label or newly configured VRF instead it keeps this in mpls table as ‘Null’
Only action to force re-use freed-up labels to either reboot or restart bgpd.

I remember seeing this issue in FRR v9 but thought its covered in VYOS.
Any suggestions here to either enlarge BGP VRF labels pool statically or dynamically. otherthan using VRF static label instead of auto.

Thanks

2

running version

VyOS 1.5-rolling-202403010026

3

are you using LDP or BGP LU to the label distribution ? I don’t see any significant bug in FRR/9.1 that is current version that we use. Could you share your configuration ?

4

LDP + MPBGP

This is VRF config, rest of VRFs are exactly same config

set vrf name VRF9963 protocols bgp address-family ipv4-unicast export vpn
set vrf name VRF9963 protocols bgp address-family ipv4-unicast import vpn
set vrf name VRF9963 protocols bgp address-family ipv4-unicast label vpn export 'auto'
set vrf name VRF9963 protocols bgp address-family ipv4-unicast rd vpn export '172.27.1.1:211'
set vrf name VRF9963 protocols bgp address-family ipv4-unicast route-target vpn both '56565:211'
set vrf name VRF9963 protocols bgp parameters router-id '100.100.100.1'
set vrf name VRF9963 protocols bgp system-as '65501'
set vrf name VRF9963 table '9963'

Here you can see MPLS table output, BGP label pool is 80-207

PE:~$  show mpls table
 Inbound Label  Type  Nexthop        Outbound Label
 ----------------------------------------------------
 16             LDP   100.65.72.1    72520
 17             LDP   100.65.72.1    24050
 18             LDP   100.65.72.1    24066
 19             LDP   100.65.72.1    24021
 20             LDP   100.65.72.1    24084
 21             LDP   100.65.72.1    24083
 22             LDP   100.65.72.1    24053
 23             LDP   100.65.72.1    24052
 24             LDP   100.65.72.1    24082
 25             LDP   100.65.72.1    24081
 26             LDP   100.65.72.1    102008
 27             LDP   100.65.72.1    44836
 28             LDP   100.65.72.1    71271
 29             LDP   100.65.72.1    24062
 30             LDP   100.65.72.1    24047
 31             LDP   100.65.72.1    24078
 32             LDP   100.65.72.1    24077
 33             LDP   100.65.72.1    24076
 34             LDP   100.65.72.1    24046
 35             LDP   100.65.72.1    24075
 36             LDP   100.65.72.1    24074
 37             LDP   100.65.72.1    24071
 38             LDP   100.65.72.1    24045
 39             LDP   100.65.72.1    24044
 40             LDP   100.65.72.1    24043
 41             LDP   100.65.72.1    24042
 42             LDP   100.65.72.1    24040
 43             LDP   100.65.72.1    24039
 44             LDP   100.65.72.1    24038
 45             LDP   100.65.72.1    24037
 46             LDP   100.65.72.1    24036
 47             LDP   100.65.72.1    24070
 48             LDP   100.65.72.1    24035
 49             LDP   100.65.72.1    24069
 50             LDP   100.65.72.1    24068
 51             LDP   100.65.72.1    24034
 52             LDP   100.65.72.1    24058
 53             LDP   100.65.72.1    24060
 54             LDP   100.65.72.1    24048
 55             LDP   100.65.72.1    24051
 56             LDP   100.65.72.1    24090
 57             LDP   100.65.72.1    72519
 58             LDP   100.65.72.1    24028
 59             LDP   100.65.72.1    24017
 60             LDP   100.65.72.1    24022
 61             LDP   100.65.72.1    24059
 62             LDP   100.65.72.1    24056
 63             LDP   100.65.72.1    24080
 64             LDP   100.65.72.1    24065
 65             LDP   100.65.72.1    24007
 66             LDP   100.65.72.1    implicit-null
 67             LDP   100.65.72.1    24024
 68             LDP   100.65.72.1    24023
 69             LDP   100.65.72.1    24026
 70             LDP   100.65.72.1    24025
 71             LDP   100.65.72.1    24020
 72             LDP   100.65.72.1    24015
 73             LDP   100.65.72.1    24049
 74             LDP   100.65.72.1    24041
 75             LDP   100.65.72.1    24027
 76             LDP   100.65.72.1    24031
 77             LDP   100.65.72.1    24064
 78             LDP   100.65.72.1    24073
 79             LDP   100.65.72.1    24019
 80             BGP   VRF1109        -
 81             BGP   VRF2324        -
 82             BGP   VRF4330        -
 83             BGP   VRF9310        -
 84             BGP   VRF4838        -
 85             BGP   VRF9678        -
 86             BGP   VRF9546        -
 87             BGP   VRF9440        -
 88             BGP   VRF9426        -
 89             BGP   VRF9415        -
 90             BGP   VRF9384        -
 91             BGP   VRF9356        -
 92             BGP   VRF9334        -
 93             BGP   VRF9288        -
 94             BGP   VRF9324        -
 95             BGP   VRF9249        -
 96             BGP   VRF9211        -
 97             BGP   VRF9148        -
 98             BGP   VRF9085        -
 99             BGP   VRF9017        -
 100            BGP   VRF8959        -
 101            BGP   VRF8919        -
 102            BGP   VRF8898        -
 103            BGP   VRF8883        -
 104            BGP   VRF8878        -
 105            BGP   VRF8873        -
 106            BGP   VRF8773        -
 107            BGP   VRF8742        -
 108            BGP   VRF8718        -
 109            BGP   VRF9834        -
 110            BGP   VRF8688        -
 111            BGP   VRF8683        -
 112            BGP   VRF8674        -
 113            BGP   VRF8638        -
 114            BGP   VRF8591        -
 115            BGP   VRF8464        -
 116            BGP   VRF8461        -
 117            BGP   VRF8382        -
 118            BGP   VRF8348        -
 119            BGP   VRF8298        -
 120            BGP   VRF8281        -
 121            BGP   VRF8275        -
 122            BGP   VRF8126        -
 123            BGP   VRF8073        -
 124            BGP   VRF8062        -
 125            BGP   VRF9552        -
 126            BGP   VRF7984        -
 127            BGP   VRF7952        -
 128            BGP   VRF7949        -
 129            BGP   VRF7859        -
 130            BGP   VRF7774        -
 131            BGP   VRF7744        -
 132            BGP   VRF7672        -
 133            BGP   VRF7650        -
 134            BGP   VRF7591        -
 135            BGP   VRF7565        -
 136            BGP   VRF7439        -
 137            BGP   VRF7428        -
 138            BGP   VRF7372        -
 139            BGP   VRF7286        -
 140            BGP   VRF7243        -
 141            BGP   VRF9958        -
 142            BGP   VRF7166        -
 143            BGP   VRF7160        -
 144            BGP   VRF7159        -
 145            BGP   VRF7139        -
 146            BGP   VRF7109        -
 147            BGP   VRF7092        -
 148            BGP   VRF7069        -
 149            BGP   VRF9963        -
 150            BGP   VRF7002        -
 151            BGP   VRF6995        -
 152            BGP   VRF6920        -
 153            BGP   VRF6897        -
 154            BGP   VRF6802        -
 155            BGP   VRF6785        -
 156            BGP   VRF6777        -
 157            BGP   VRF4315        -
 158            BGP   VRF9697        -
 159            BGP   VRF6704        -
 160            BGP   VRF6653        -
 161            BGP   VRF6630        -
 162            BGP   VRF6529        -
 163            BGP   VRF6500        -
 164            BGP   VRF6405        -
 165            BGP   VRF9889        -
 166            BGP   VRF6300        -
 167            BGP   VRF6275        -
 168            BGP   VRF6260        -
 169            BGP   VRF6239        -
 170            BGP   VRF6197        -
 171            BGP   VRF6164        -
 172            BGP   VRF6156        -
 173            BGP   VRF9eb291666  -
 174            BGP   VRF5985        -
 175            BGP   VRF5960        -
 176            BGP   VRF5935        -
 177            BGP   VRF5926        -
 178            BGP   VRF5921        -
 179            BGP   VRF5881        -
 180            BGP   VRF5808        -
 181            BGP   VRF4793        -
 182            BGP   VRF5802        -
 183            BGP   VRF5705        -
 184            BGP   VRF5694        -
 185            BGP   VRF5648        -
 186            BGP   VRF5604        -
 187            BGP   VRF5579        -
 188            BGP   VRF5563        -
 189            BGP   VRF9714        -
 190            BGP   VRF5550        -
 191            BGP   VRF5461        -
 192            BGP   VRF5440        -
 193            BGP   VRF5386        -
 194            BGP   VRF5368        -
 195            BGP   VRF5338        -
 196            BGP   VRF5237        -
 197            BGP   VRF5220        -
 198            BGP   VRF5209        -
 199            BGP   VRF5197        -
 200            BGP   VRF5152        -
 201            BGP   VRF5066        -
 202            BGP   VRF5034        -
 203            BGP   VRF4930        -
 204            BGP   VRF9722        -
 205            BGP   VRF2610        -
 206            BGP   VRF2540        -
 207            BGP   VRF4750        -
 208            LDP   100.65.72.1    24018
 209            LDP   100.65.72.1    24030
 210            LDP   100.65.72.1    24029
 211            LDP   100.65.72.1    24072
 212            LDP   100.65.72.1    24067
 213            LDP   100.65.72.1    25153
 214            LDP   100.65.72.1    25152
 215            LDP   100.65.72.1    24063
 216            LDP   100.65.72.1    24091
 217            LDP   100.65.72.1    72909
 218            LDP   100.65.72.1    86376
 219            LDP   100.65.72.1    173848
 220            LDP   100.65.72.1    24089
 221            LDP   100.65.72.1    24055
 222            LDP   100.65.72.1    24054
 223            LDP   100.65.72.1    103815
 224            LDP   100.65.72.1    98815
 225            LDP   100.65.72.1    24342
 228            LDP   100.65.72.1    24000
 229            LDP   100.65.72.1    24003
 230            LDP   100.65.72.1    24088
 231            LDP   100.65.72.1    24095
 232            LDP   100.65.72.1    24094
 233            LDP   100.65.72.1    24096
 234            LDP   100.65.72.1    24097
 235            LDP   100.65.72.1    24092
 236            LDP   100.65.72.1    24093
 237            LDP   100.65.72.1    43796
 238            LDP   100.65.72.1    41778
5

I haven’t found any interested information about that you mentioned , open a case with FRR in GitHub if there is any limitation or a way to expand the label location to bgp.

6

Thanks Fernando for checking. I cut this with FRR Limited number of VRFs in VPNv4 · Issue #16744 · FRRouting/frr · GitHub and following up there.

7

thanks for sharing, yes, looks like a bug with the bgp labels range.