Seems bgpd-process consumes a lot of memory or memory leak

Bugs
1

Hi all,

Seems we have a trouble with BGP consumes a lot of memory in VM vyos.
When all peerings were bringed up, it was like this , a bit more than 400M of memory

admin@nn-lns-3-1:~$    top
top - 03:42:33 up  1:27,  3 users,  load average: 0.07, 0.04, 0.01
Tasks: 145 total,   1 running, 144 sleeping,   0 stopped,   0 zombie
%Cpu(s):  0.3 us,  0.2 sy,  0.0 ni, 99.4 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :  16019.9 total,  13710.6 free,   2005.3 used,    303.9 buff/cache
MiB Swap:      0.0 total,      0.0 free,      0.0 used.  13595.3 avail Mem 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                                                   
   1065 frr       20   0  406852 235740   6508 S   6.6   1.4   5:49.33 bgpd                                                      
      1 root      20   0  165156  10572   7792 S   0.0   0.1   0:03.93 systemd

Peering looks like in output below

admin@nn-lns-3-1:~$ sho bgp summary 

IPv4 Unicast Summary (VRF default):
BGP router identifier 10.228.134.1, local AS number 64826 vrf-id 0
BGP table version 1034
RIB entries 1557, using 280 KiB of memory
Peers 5, using 3617 KiB of memory

Neighbor        V         AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt Desc
10.228.134.32   4      64516      1791      1758        0    0    0 01:27:42           53        4 SC-x-1 vrf 
10.228.134.34   4      64516      1792      1758        0    0    0 01:27:42           53        4 SC-x-2 vrf 
10.228.134.36   4      64516      1778      1758        0    0    0 01:27:42          202        4 SC-x-1 vrf 
10.228.134.38   4      64516      1778      1758        0    0    0 01:27:42          202        4 SC-x-2 vrf 
10.228.134.102  4      64826       317       316        0    0    0 01:16:32          256      837 ipv4 

Total number of neighbors 5

IPv4 VPN Summary (VRF default):
BGP router identifier 10.228.134.1, local AS number 64826 vrf-id 0
BGP table version 0
RIB entries 1949, using 350 KiB of memory
Peers 3, using 2170 KiB of memory

Neighbor        V         AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt Desc
10.5.72.1       4      39374    564924    313205        0    0    0 01:27:39        34687    34689 BBR1 vpnv4
10.5.72.2       4      39374    560598    313205        0    0    0 01:27:39        34687    34689 BBR2 vpnv4
10.228.134.101  4      64826    357407    358698        0    0    0 01:16:32        34689    34686 vLNS-4-1 

Total number of neighbors 3

IPv4 Labeled Unicast Summary (VRF default):
BGP router identifier 10.228.134.1, local AS number 64826 vrf-id 0
BGP table version 3
RIB entries 5, using 920 bytes of memory
Peers 2, using 1447 KiB of memory

Neighbor        V         AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt Desc
10.228.134.40   4      39374       406        91        0    0    0 01:27:42          581        4 BBR1 ipv4 LU
10.228.134.42   4      39374       405        91        0    0    0 01:27:42          581        4 BBR2 ipv4 LU

Total number of neighbors 2

On July 29th bgp have already consumed 1.8 Gigs of memory


admin@nn-lns-3-1:~$ top
top - 00:03:00 up 2 days, 21:47,  1 user,  load average: 0.10, 0.09, 0.02
Tasks: 147 total,   1 running, 146 sleeping,   0 stopped,   0 zombie
%Cpu(s):  0.2 us,  0.3 sy,  0.0 ni, 99.4 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :  16019.9 total,  12013.7 free,   3665.2 used,    340.9 buff/cache
MiB Swap:      0.0 total,      0.0 free,      0.0 used.  11917.0 avail Mem 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                                                  
   1065 frr       20   0 2109440   1.8g   6540 S   5.6  11.8 263:17.20 bgpd                                                     
      1 root      20   0  165156  10576   7792 S   0.0   0.1   0:05.11 systemd

And today, 2022-08-02, 00:10 om MSK (GMT+3) Timezone we can see that bgp consumes 4 Gigs of memory

admin@nn-vlns-3-1:~$ top
top - 00:00:42 up 6 days, 21:45,  1 user,  load average: 0.04, 0.03, 0.00
Tasks: 144 total,   1 running, 143 sleeping,   0 stopped,   0 zombie
%Cpu(s):  0.3 us,  0.2 sy,  0.0 ni, 99.5 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :  16019.9 total,   7912.9 free,   7402.8 used,    704.2 buff/cache
MiB Swap:      0.0 total,      0.0 free,      0.0 used.   8163.1 avail Mem 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                                                
   1065 frr       20   0 4340528   4.0g   8572 S   6.3  25.4 606:01.27 bgpd                                                   
   1013 root      20   0    8368   3560   2304 S   0.3   0.0   6:43.08 watchfrr

Peering hasn`t dramatically changed:
Today:

admin@nn-vlns-3-1:~$ sho bgp summary 

IPv4 Unicast Summary (VRF default):
BGP router identifier 10.228.134.1, local AS number 64826 vrf-id 0
BGP table version 2239
RIB entries 1560, using 280 KiB of memory
Peers 5, using 3617 KiB of memory

Neighbor        V         AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt Desc
10.228.134.32   4      64516    198119    198923        0    0    0 6d21h45m           53        4 SC-x-1 vrf AAA
10.228.134.34   4      64516    198107    198923        0    0    0 6d21h45m           53        4 SC-x-2 vrf AAA
10.228.134.36   4      64516    198118    198923        0    0    0 6d21h45m          202        4 SC-x-1 vrf T2-LNS
10.228.134.38   4      64516    198103    198923        0    0    0 6d21h45m          202        4 SC-x-2 vrf T2-LNS
10.228.134.102  4      64826     10466     10898        0    0    0 6d21h34m          256      839 ipv4 vLNS-4-1 AAA/T2

Total number of neighbors 5

IPv4 VPN Summary (VRF default):
BGP router identifier 10.228.134.1, local AS number 64826 vrf-id 0
BGP table version 0
RIB entries 1965, using 353 KiB of memory
Peers 3, using 2170 KiB of memory

Neighbor        V         AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt Desc
10.5.72.1       4      39374  55349635  31842495        0    0    0 6d21h45m        35683    35692 BBR1 vpnv4
10.5.72.2       4      39374  55169017  31842495        0    0    0 6d21h45m        35683    35692 BBR2 vpnv4
10.228.134.101  4      64826  41267796  41476345        0    0    0 6d21h34m        35687    35690 vLNS-4-1 VPNV4

Total number of neighbors 3

IPv4 Labeled Unicast Summary (VRF default):
BGP router identifier 10.228.134.1, local AS number 64826 vrf-id 0
BGP table version 3
RIB entries 5, using 920 bytes of memory
Peers 2, using 1447 KiB of memory

Neighbor        V         AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt Desc
10.228.134.40   4      39374     13565      9949        0    0    0 6d21h45m          583        4 BBR1 ipv4 LU
10.228.134.42   4      39374     13612      9949        0    0    0 6d21h45m          583        4 BBR2 ipv4 LU

Total number of neighbors 2
admin@nn-vlns-3-1:~$

version is 1.4

admin@nn-vlns-3-1:~$ sho version 

Version:          VyOS 1.4-rolling-202206071305
Release train:    sagitta

Built by:         alexander.serkin@gmail.com
Built on:         Tue 07 Jun 2022 13:05 UTC
Build UUID:       6b0e27db-4f48-4d84-8ccd-fcd7d50d8c57
Build commit ID:  06a1dc8ccc7a39

Architecture:     x86_64
Boot via:         installed image
System type:      KVM guest

Hardware vendor:  Red Hat
Hardware model:   KVM
Hardware S/N:     
Hardware UUID:    109949e4-96b7-44ee-8c96-a111bb36bd23

Copyright:        VyOS maintainers and contributors
admin@nn-vlns-3-1:~$

Does it sounds like a memory leak ?

2

Please upgrade to a more recent VyOs version. There have already been some bugfixes to bgp in concerns of memory to the 8.3 FRR release.

—
Christian

3

Could you specify certain release where bugfixes is included?
And what bugfixes are, for what bugs?

4

There have been memory leak fixes in FRR itself.See Release FRR 8.3 Release · FRRouting/frr · GitHub and other changelogs for instance.

The latest nightly contains the latest FRR so those should be fixed. If not, then it is at least know it is a new bug.

Sander

5

Thanks

we upgraded to release with 8.3.8 FRR last night.
so will see what will be

6

So, almost 24 hours spent. BGP sessions have already established 23:55:46.
And it also begans from 400 Megs of memory,
now bgpd eats almost 1Gig
Prefixes are the same.

I could predict that after approx 6 day about 3 Gigs will be eaten.

May be some other ideas except next upgrade?


admin@nn-vlns-3-1:~$ top
top - 00:17:53 up 1 day, 0 min,  1 user,  load average: 0.04, 0.04, 0.00
Tasks: 141 total,   1 running, 139 sleeping,   0 stopped,   1 zombie
%Cpu(s):  0.2 us,  0.3 sy,  0.0 ni, 99.5 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :  16020.0 total,  11483.2 free,   4074.8 used,    462.1 buff/cache
MiB Swap:      0.0 total,      0.0 free,      0.0 used.  11675.4 avail Mem 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                                                
   4104 root      20   0 3380772   3.0g   4752 S   0.0  19.2   0:08.79 accel-pppd                                             
    922 frr       15  -5  945012 770512   8252 S   6.3   4.7  88:02.66 bgpd
7

Maybe vtysh -c 'show memory bgpd' will give more info.

8

Thanks,

Here is, today, 2022-08-05, 00:03

admin@nn-vlns-3-1:~$ vtysh -c 'show memory bgpd'
System allocator statistics:
  Total heap allocated:  1273 MiB
  Holding block headers: 19 MiB
  Used small blocks:     0 bytes
  Used ordinary blocks:  1272 MiB
  Free small blocks:     4576 bytes
  Free ordinary blocks:  828 KiB
  Ordinary blocks:       422
  Small blocks:          77
  Holding blocks:        28
(see system documentation for 'mallinfo' for meaning)
--- qmem libfrr ---
Type                          : Current#   Size       Total     Max#  MaxBytes
Buffer                        :        6     24         144        7       168
Buffer data                   :        1 variable      4120        1      4136
Host config                   :        6 variable       240        6       240
Command Tokens                :    12401     72      893384    12411    894104
Command Token Text            :     8983 variable    312568     8993    313096
Command Token Help            :     8983 variable    216552     8993    216776
Command Argument              :        2 variable        64       12       288
Command Argument Name         :     2120 variable     50912     2130     51152
Lexer token (temporary)       :        0 variable         0        2        64
RCU thread                    :        2    128         272        2       272
RCU sequence barrier          :        1     32          40        1        40
FRR POSIX Thread              :        4 variable       320        4       320
POSIX sync primitives         :        4 variable       192        4       192
Graph                         :       44      8        1056       45      1080
Graph Node                    :    14650     32      587728    14652    587808
Hash                          :      641 variable     31496      641     31528
Hash Bucket                   :     8535     32      342840     8768    355648
Hash Index                    :      321 variable    568728      322    601488
Interface                     :       24    272        6720       27      7576
Connected                     :       34     48        1920       37      2088
Link List                     :      140     40        5664      148      6016
Link Node                     :      483     24       11752      612     16224
Temporary memory              :    63037 variable   8582408    65472   8913584
Bitfield memory               :        2 variable     10256        2     10256
Module loading name           :        3 variable        72        3        72
Nexthop                       :       26    144        4032       28      4368
Nexthop label                 :       20      8         480       21       504
Northbound Node               :      240   1192      286080      240    286080
Northbound Configuration      :        2     16          48        2        48
Northbound Configuration Entry:       15   1032       15480       15     15480
Prefix List                   :        1     88          88        1        88
Prefix List Str               :        1     12          24        1        24
Prefix List Entry             :        2    136         272        2       272
Prefix List Trie Table        :        2   4096        8208        2      8208
Prefix                        :       36     56        2048       40      2272
Privilege information         :        3 variable       136        3       136
Ring buffer                   :       24 variable   7913760       28   9224544
Route map                     :        4    120         480        4       480
Route map name                :        4 variable        96        5       120
Route map index               :        4    152         624        4       624
Route map rule                :        4     40         176        4       176
Route map rule str            :        4     10          96        4        96
Route map compiled            :        4     16          96        4        96
Skip List                     :    31553     56     1780456    32774   1864536
Skip Node                     :   140814 variable   9750528   145694  10104704
Skiplist Counters             :    31553     68     2272024    32774   2359824
Socket union                  :       20    112        2448       24      2928
Stream                        :       41 variable   2253016      846   2839088
Stream FIFO                   :       24     64        1728       28      2016
Route table                   :     1151     56       69496     1151     69496
Route node                    :        8    120         960        8       960
Thread                        :       53    160        8936    31765   5340392
Thread master                 :       12 variable     50352       12     50352
Thread Poll Info              :        6   8192       49200        6     49200
Thread stats                  :       29     96        3032       29      3032
Typed-hash bucket             :      991 variable   1388680      995   1426072
Typed-heap array              :        1 variable       776        1    334280
Vector                        :    29391     24      706456    29395    706520
Vector index                  :    29391 variable    931144    29395    931336
VRF                           :        4    216         864        4       864
VRF bit-map                   :        8      8         192        8       192
VTY                           :        4 variable     61088        4     61088
VTY server                    :        2     32          80        2        80
Work queue                    :        6    152         928        7      1080
Work queue item               :        1     24          24    36244   1051200
Work queue name string        :        6 variable       144        7       168
YANG module                   :        5     48         296        5       296
YANG data structure           :        0   1032           0        1      1032
Zclient                       :        2   3144        6288        2      6288
Redistribution instance IDs   :        6      2         144        6       144
log thread-local buffer       :        2  24608       49232        2     49232
--- qmem logging subsystem ---
Type                          : Current#   Size       Total     Max#  MaxBytes
syslog target                 :        2     56         112        2       112
--- qmem bgpd ---
Type                          : Current#   Size       Total     Max#  MaxBytes
BGP Label Chunk               :       12      8         288       12       288
BGP Label FIFO item           :        0     32           0      288     11520
BGP Dynamic Label Assignment  :      587     24       14136      588     14176
BGP Dynamic Label Callback    :        0     32           0      295     11800
Mac Hash Entry                :       16     16         384       16       384
Mac Hash Entry Intf String    :       24 variable       576       28       672
BGP instance                  :        6 variable     19616        6     19616
BGP listen socket details     :        6 variable       656        6       656
BGP peer                      :       18 740832    13343440       19  14084280
BGP peer hostname             :       22 variable       528       25       600
Peer description              :       10 variable       256       10       256
BGP peer af                   :       10     80         880       12      1088
BGP update group              :        6    104         624        6       640
BGP update subgroup           :        6    240        1488        6      1488
BGP packet                    :        6     56         336       43      3048
BGP attribute                 :     5469    304     1706424     5485   1711432
BGP aspath                    :      242     40        9680      243      9736
BGP aspath seg                :      241     24        6184      242      6224
BGP aspath segment data       :      241 variable      5800      243      5880
BGP aspath str                :      242 variable     10080      243     10168
BGP table                     :     1130     56       66208     1130     66208
BGP node                      :    74645    192    14933784    77091  15423320
BGP route                     :   218171    112    26211080   225501  27090200
BGP ancillary route info      :   217397    400    88700776   224727  91691368
BGP connected                 :       16      4         400       16       416
BGP static                    :        5    144         760        5       760
BGP adv attr                  :        0     24           0     1455     34920
BGP adv                       :        0     64           0    36853   2667464
BGP synchronise               :      258     72       18800      299     22424
BGP adj in                    :    72860     48     4159824    75302   4314336
BGP adj out                   :    72926     96     7604560    75369   7857752
BGP multipath info            :    15362     48      883712    15757    905912
community                     : 14055258     40   575848688 14055259 575848728
community val                 : 14055258 variable 338219888 14055259 338219912
community str                 :       60 variable    483840       61    492040
extcommunity                  :      268     40       10992      269     11048
extcommunity val              :      268 variable      6816      269      6872
extcommunity str              :      266 variable     23888      266     23888
community-list handler        :        1    120         136        1       136
BGP Process queue             :        1     32          40        5       200
BGP node clear queue          :        0      8           0    36243   1051544
BGP nexthop                   :       20    184        3696       20      3696
BGP peer update interface     :        4      5          96        6       144
BGP own address               :       14     64        1008       14      1008
BGP redistribution            :        2     24          48        2        48
BGP Filter Information        :       16 variable       384       17       408
BGP EVPN MH Information       :        1     56          72        1        72
BGP Notification Message      :        0 variable         0        2        48
BGP Martian Addr Intf String  :       15 variable       360       16       384
BGP PBR Context               :        2     32          80        2        80
BGP EVPN instance information :        2     56         112        2       112
--- qmem rfapi ---
Type                          : Current#   Size       Total     Max#  MaxBytes
NVE Configuration             :        1   2984        2984        1      2984
RFAPI Generic                 :        1    296         296        1       296
RFAPI Import Table            :        1    208         216        1       216
RFAPI Monitor Encap           :   108087     40     4359272   111751   4508968
RFAPI Withdraw                :        0     32           0    31718   1601192
RFAPI IT Extra                :    31590     40     1275840    32809   1325240
--- qmem BMP (BGP Monitoring Protocol) ---
Type                          : Current#   Size       Total     Max#  MaxBytes
BMP per BGP peer data         :       14     56         832       14       832
BMP stored BGP OPEN message   :       28 variable      2592       28      2592
admin@nn-vlns-3-1:~$

And top

admin@nn-vlns-3-1:~$ top
top - 00:01:33 up 1 day, 23:43,  1 user,  load average: 0.03, 0.03, 0.00
Tasks: 144 total,   1 running, 142 sleeping,   0 stopped,   1 zombie
%Cpu(s):  0.4 us,  0.5 sy,  0.0 ni, 99.1 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :  16020.0 total,  10928.3 free,   4621.3 used,    470.4 buff/cache
MiB Swap:      0.0 total,      0.0 free,      0.0 used.  11128.7 avail Mem 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                                                
   4104 root      20   0 3446308   3.0g   4752 S   0.0  19.2   0:13.05 accel-pppd                                             
    922 frr       15  -5 1503136   1.3g   8252 S   8.1   8.1 176:43.43 bgpd
9

Thanks!

There might be something wrong with the BGP community memory usage. It seems that you have 200k routes, but 14M community entries. Is there any chance that the router tries to abuse community, for example by adding it in a loop, etc.? Or any peer floods with the same prefixes but different communities?

I would check the config carefully and community lists. Maybe vtysh -c 'show ip bgp community-info' can be a good point to start. Be careful - I hope it will not hang the router, but better to not check this in prime time. :slight_smile:

10

How I could attach full config of the router?

Is it possible via kind of private message ?

11

Yes, sure. You can share sensitive info here via private message.

12

current output, 2022-0809, 00:12

admin@nn-vlns-3-1:~$ vtysh -c 'show memory bgpd'
System allocator statistics:
  Total heap allocated:  > 2GB
  Holding block headers: 19 MiB
  Used small blocks:     0 bytes
  Used ordinary blocks:  > 2GB
  Free small blocks:     4080 bytes
  Free ordinary blocks:  1535 KiB
  Ordinary blocks:       1872
  Small blocks:          74
  Holding blocks:        29
(see system documentation for 'mallinfo' for meaning)
--- qmem libfrr ---
Type                          : Current#   Size       Total     Max#  MaxBytes
Buffer                        :        6     24         144        7       168
Buffer data                   :        1 variable      4120        3     12360
Host config                   :        6 variable       240        6       240
Command Tokens                :    12401     72      893384    12411    894104
Command Token Text            :     8983 variable    312568     8993    313096
Command Token Help            :     8983 variable    216536     8993    216776
Command Argument              :        2 variable        48       12       288
Command Argument Name         :     2120 variable     50912     2130     51152
Lexer token (temporary)       :        0 variable         0        2        64
RCU thread                    :        2    128         272        2       272
RCU sequence barrier          :        1     32          40        1        40
FRR POSIX Thread              :        4 variable       320        4       320
POSIX sync primitives         :        4 variable       192        4       192
Graph                         :       44      8        1056       45      1080
Graph Node                    :    14650     32      587728    14652    587808
Hash                          :      641 variable     31496      641     31528
Hash Bucket                   :     8715     32      350104     8777    355648
Hash Index                    :      321 variable    568728      322    601488
Interface                     :       24    272        6720       27      7576
Connected                     :       33     48        1864       37      2088
Link List                     :      140     40        5680      148      6016
Link Node                     :      481     24       11704      612     16224
Temporary memory              :    63078 variable   8588736    66926   9113232
Bitfield memory               :        2 variable     10256        2     10256
Module loading name           :        3 variable        72        3        72
Nexthop                       :       26    144        4032       28      4368
Nexthop label                 :       20      8         480       21       504
Northbound Node               :      240   1192      286080      240    286080
Northbound Configuration      :        2     16          48        2        48
Northbound Configuration Entry:       15   1032       15480       15     15480
Prefix List                   :        1     88          88        1        88
Prefix List Str               :        1     12          24        1        24
Prefix List Entry             :        2    136         272        2       272
Prefix List Trie Table        :        2   4096        8208        2      8208
Prefix                        :       34     56        1936       40      2272
Privilege information         :        3 variable       136        3       136
Ring buffer                   :       24 variable   7913760       28   9224544
Route map                     :        4    120         480        4       480
Route map name                :        4 variable        96        5       120
Route map index               :        4    152         624        4       624
Route map rule                :        4     40         176        4       176
Route map rule str            :        4     10          96        4        96
Route map compiled            :        4     16          96        4        96
Skip List                     :    31573     56     1778424    33500   1889264
Skip Node                     :   140937 variable   9756920   148639  10314416
Skiplist Counters             :    31573     68     2273400    33500   2412288
Socket union                  :       20    112        2448       24      2928
Stream                        :       41 variable   2253016      846   2839088
Stream FIFO                   :       24     64        1728       28      2016
Route table                   :     1151     56       69496     1151     69496
Route node                    :        8    120         960        8       960
Thread                        :       53    160        8984    31765   5340392
Thread master                 :       12 variable     50352       12     50352
Thread Poll Info              :        6   8192       49200        6     49200
Thread stats                  :       29     96        3032       29      3032
Typed-hash bucket             :      991 variable   1397120      995   1968096
Typed-heap array              :        1 variable       776        1    334280
Vector                        :    29391     24      706424    29395    706520
Vector index                  :    29391 variable    931144    29395    931336
VRF                           :        4    216         864        4       864
VRF bit-map                   :        8      8         192        8       192
VTY                           :        4 variable     61088        4     61088
VTY server                    :        2     32          80        2        80
Work queue                    :        6    152         928        7      1080
Work queue item               :        1     24          24    36244   1051200
Work queue name string        :        6 variable       144        7       168
YANG module                   :        5     48         296        5       296
YANG data structure           :        0   1032           0        1      1032
Zclient                       :        2   3144        6288        2      6288
Redistribution instance IDs   :        6      2         144        6       144
log thread-local buffer       :        2  24608       49232        2     49232
--- qmem logging subsystem ---
Type                          : Current#   Size       Total     Max#  MaxBytes
syslog target                 :        2     56         112        2       112
--- qmem bgpd ---
Type                          : Current#   Size       Total     Max#  MaxBytes
BGP Label Chunk               :       12      8         288       12       288
BGP Label FIFO item           :        0     32           0      288     11520
BGP Dynamic Label Assignment  :      587     24       14168      588     14176
BGP Dynamic Label Callback    :        0     32           0      295     11800
Mac Hash Entry                :       16     16         384       16       384
Mac Hash Entry Intf String    :       24 variable       576       28       672
BGP instance                  :        6 variable     19616        6     19616
BGP listen socket details     :        6 variable       656        6       656
BGP peer                      :       18 740832    13343440       19  14084280
BGP peer hostname             :       22 variable       528       25       600
Peer description              :       10 variable       256       10       256
BGP peer af                   :       10     80         880       12      1088
BGP update group              :        6    104         624        6       640
BGP update subgroup           :        6    240        1488        6      1488
BGP packet                    :        6     56         336       43      3048
BGP attribute                 :     5646    304     1761648     5677   1771320
BGP aspath                    :      243     40        9720      244      9776
BGP aspath seg                :      242     24        6208      243      6248
BGP aspath segment data       :      242 variable      5824      244      5904
BGP aspath str                :      243 variable     10120      244     10192
BGP table                     :     1130     56       66208     1130     66208
BGP node                      :    74710    192    14946912    78598  15725040
BGP route                     :   218375    112    26231288   229954  27627648
BGP ancillary route info      :   217602    400    88784096   229180  93508272
BGP connected                 :       16      4         384       16       416
BGP static                    :        5    144         760        5       760
BGP adv attr                  :        0     24           0     1455     34920
BGP adv                       :        0     64           0    36853   2667464
BGP synchronise               :      258     72       18800      299     22424
BGP adj in                    :    72927     48     4151016    76788   4378768
BGP adj out                   :    72990     96     7612784    76878   8016256
BGP multipath info            :    15598     48      892576    16365    937128
community                     : 43310899     40   1774589064 43310900 1774589104
community val                 : 43310899 variable 1041792632 43310900 1041792656
community str                 :       60 variable    483840       61    492040
extcommunity                  :      270     40       11072      271     11128
extcommunity val              :      270 variable      6864      271      6920
extcommunity str              :      268 variable     24160      268     24160
community-list handler        :        1    120         136        1       136
BGP Process queue             :        1     32          40        5       200
BGP node clear queue          :        0      8           0    36243   1051544
BGP nexthop                   :       20    184        3696       20      3696
BGP peer update interface     :        4      5          96        6       144
BGP own address               :       14     64        1008       14      1008
BGP redistribution            :        2     24          48        2        48
BGP Filter Information        :       16 variable       384       17       408
BGP EVPN MH Information       :        1     56          72        1        72
BGP Notification Message      :        0 variable         0        2        48
BGP Martian Addr Intf String  :       14 variable       336       16       384
BGP PBR Context               :        2     32          80        2        80
BGP EVPN instance information :        2     56         112        2       112
--- qmem rfapi ---
Type                          : Current#   Size       Total     Max#  MaxBytes
NVE Configuration             :        1   2984        2984        1      2984
RFAPI Generic                 :        1    296         296        1       296
RFAPI Import Table            :        1    208         216        1       216
RFAPI Monitor Encap           :   108190     40     4364864   113978   4596128
RFAPI Withdraw                :        0     32           0    31718   1601192
RFAPI IT Extra                :    31609     40     1276072    33536   1353904
--- qmem BMP (BGP Monitoring Protocol) ---
Type                          : Current#   Size       Total     Max#  MaxBytes
BMP per BGP peer data         :       14     56         832       14       832
BMP stored BGP OPEN message   :       28 variable      2592       28      2592
admin@nn-vlns-3-1:~$

and here for community:

admin@nn-vlns-3-1:~$ vtysh -c 'show ip bgp community-info'
Address Refcnt Community
[0x5620f72cb310] (820) 861:2100 7992:1102
[0x5620f7344c60] (2479436) 7991:1102 7992:1102 7992:1202
[0x5620f801a510] (39196789) 7552:1102 7992:1102 7992:1202
[0x5620f7f1c970] (382593) 938:2000 7992:1102 7992:1202
[0x5620fc9aa060] (81) 861:2050 7992:1102
[0x5620fa073160] (87066) 852:2050 7522:1102 7992:1102 7992:1202
[0x5620f72e4e50] (1125) 877:1050 877:2050 7992:1102 7992:1202
[0x5620f72d9200] (1125) 877:1150 877:2050 7992:1102 7992:1202
[0x5620f95683e0] (19) 877:2050 978:2000 7992:1102 7992:1202
[0x5620f733b360] (5438884) 852:2050 7992:1102 7992:1202
[0x56211c513af0] (2) 852:2050 977:2000 7992:1102 7992:1202
[0x5620f9e222e0] (138) 951:2000 7992:1102 7992:1202
[0x5620f9504930] (162137) 877:2050 977:2000 7992:1102 7992:1202
[0x5620fa04bb00] (28818421) 878:2050 7522:1102 7992:1102 7992:1202
[0x5620f9e2a440] (23) 878:2050 978:2000 7992:1102 7992:1202
[0x5620f7344390] (352) 852:2100 7992:1102 7992:1202
[0x5620f7e92ab0] (173618) 977:2000 7992:1102 7992:1202
[0x5620f9983e20] (65) 7782:1102 7992:1102 7992:1202
[0x5620f9924140] (10539) 932:2000 7992:1102 7992:1202
[0x5620f733b620] (393291) 7522:1102
[0x5620f9501320] (10624) 877:2050 932:2000 7992:1102 7992:1202
[0x56212c754a70] (8) 852:2050 852:2100 7992:1102 7992:1202
[0x5620f956ff10] (19) 877:2050 938:2000 7992:1102 7992:1202
[0x5620f7303820] (29974760) 7522:1102 7992:1102 7992:1202
[0x5620f9e1d530] (92) 878:2050 951:2000 7992:1102 7992:1202
[0x5620f956ae10] (69) 877:2050 931:2000 7992:1102 7992:1202
[0x5620f72d3010] (92194427) 878:2050 7992:1102 7992:1202
[0x5620f732d140] (825414) 877:2050 7991:1102 7992:1102 7992:1202
[0x5620f9ed1ad0] (584208) 852:2050 7991:1102 7992:1102 7992:1202
[0x5620f6f448e0] (3868) no-export
[0x5620f7320de0] (32641646) 959:2000 7992:1102 7992:1202
[0x5620f99b9bd0] (80084) 971:2000 7992:1102 7992:1202
[0x5620f70f1d30] (4) 7521:1102
[0x5620f72a1820] (42) 852:2100
[0x5620f93297f0] (138) 952:2000 7992:1102
[0x5620fb9bd700] (1626714) 852:2050 918:2000 7992:1102 7992:1202
[0x5620fc9d4d90] (23) 999:2000 7992:1102
[0x5620f7224d70] (110456765) 7992:1102 7992:1202
[0x5620f9313060] (107) 852:2100 999:2000 7522:1102
[0x5620f92dcd40] (5005) 7522:1102 7772:1102
[0x5620f8ca3970] (1795435) 852:2050 952:2000 7992:1102 7992:1202
[0x5620f736c7b0] (3431813) 918:2000 7992:1102 7992:1202
[0x5620f72a5c80] (75) 852:2050
[0x5620f9579150] (85573) 877:2050 971:2000 7992:1102 7992:1202
[0x5620f9e2d000] (23) 878:2050 938:2000 7992:1102 7992:1202
[0x5620f939d0e0] (57) 877:2050 918:2000 7992:1102 7992:1202
[0x5620f997d140] (69) 931:2000 7992:1102 7992:1202
[0x5620f937cae0] (383) 7522:1102 7772:1102 7782:1102
[0x5620f734a800] (3444904) 952:2000 7992:1102 7992:1202
[0x5620f97f1f80] (855) 877:1150 7992:1102 7992:1202
[0x5620f731b520] (29694039) 878:2050 7552:1102 7992:1102 7992:1202
[0x5620f72db9c0] (5606913) 877:2050 7992:1102 7992:1202
[0x5620f97dddf0] (855) 877:1050 7992:1102 7992:1202
[0x5620f79f3230] (174996) 852:2050 938:2000 7992:1102 7992:1202
[0x5620f997a7d0] (71) 978:2000 7992:1102 7992:1202
[0x5620f7225cd0] (4730) 7992:1102
[0x5620f7364320] (16186768) 852:2050 959:2000 7992:1102 7992:1202
[0x5620f9f1a380] (435249) 878:2050 7991:1102 7992:1102 7992:1202
[0x5620f9573e90] (19) 877:2050 7782:1102 7992:1102 7992:1202
[0x5620f9e2fc00] (46) 878:2050 7782:1102 7992:1102 7992:1202
admin@nn-vlns-3-1:~$

and top:

admin@nn-vlns-3-1:~$ top
top - 00:13:57 up 5 days, 23:56,  2 users,  load average: 0.07, 0.11, 0.13
Tasks: 145 total,   1 running, 143 sleeping,   0 stopped,   1 zombie
%Cpu(s):  0.3 us,  0.3 sy,  0.0 ni, 99.4 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :  16020.0 total,   8632.2 free,   6892.9 used,    494.9 buff/cache
MiB Swap:      0.0 total,      0.0 free,      0.0 used.   8857.5 avail Mem 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                                                  
    922 frr       15  -5 3821524   3.5g   8264 S   6.0  22.2 539:23.40 bgpd                                                     
   4104 root      20   0 3446308   3.0g   4752 S   0.0  19.2   0:27.12 accel-pppd
13

config for route-policy and bgp peers below

And is some docs exists about commands options with
vtysh -c 'show ...' ?

Or there are kind of regular commands, just executed from other shell (vtysh) ?

set policy prefix-list SC-IPv4-OUT rule 10 action 'permit'
set policy prefix-list SC-IPv4-OUT rule 10 le '32'
set policy prefix-list SC-IPv4-OUT rule 10 prefix '10.228.134.0/24'
set policy prefix-list SC-IPv4-OUT rule 20 action 'deny'
set policy prefix-list SC-IPv4-OUT rule 20 le '32'
set policy prefix-list SC-IPv4-OUT rule 20 prefix '0.0.0.0/0'
....

set policy route-map IPCore-IPv4-LU-IN rule 10 action 'permit'
set policy route-map IPCore-IPv4-LU-IN rule 10 set community 'no-export'
set policy route-map IPCore-IPv4-LU-OUT rule 10 action 'permit'
set policy route-map IPCore-IPv4-LU-OUT rule 10 set community '7521:1102'
set policy route-map IPCore-vpnv4-OUT rule 10 action 'permit'
set policy route-map IPCore-vpnv4-OUT rule 10 set community '7522:1102'
set policy route-map SC-IPv4-IN rule 10 action 'permit'
set policy route-map SC-IPv4-IN rule 10 set community 'no-export'
set protocols bgp address-family ipv4-unicast network 10.228.134.0/32
set protocols bgp address-family ipv4-unicast network 10.228.134.1/32
set protocols bgp address-family ipv4-labeled-unicast network 10.228.134.1/32
set protocols bgp address-family ipv4-labeled-unicast network 10.228.134.40/31
set protocols bgp address-family ipv4-labeled-unicast network 10.228.134.42/31
set protocols bgp local-as '64826'
set protocols bgp neighbor 10.5.72.1 address-family ipv4-vpn route-map export 'IPCore-vpnv4-OUT'
set protocols bgp neighbor 10.5.72.1 address-family ipv4-vpn soft-reconfiguration inbound
set protocols bgp neighbor 10.5.72.1 description 'BBR1 vpnv4'
set protocols bgp neighbor 10.5.72.1 ebgp-multihop '10'
set protocols bgp neighbor 10.5.72.1 remote-as 'XXX'
set protocols bgp neighbor 10.5.72.1 update-source 'dum1'
set protocols bgp neighbor 10.5.72.2 address-family ipv4-vpn route-map export 'IPCore-vpnv4-OUT'
set protocols bgp neighbor 10.5.72.2 address-family ipv4-vpn soft-reconfiguration
set protocols bgp neighbor 10.5.72.2 description 'BBR2 vpnv4'
set protocols bgp neighbor 10.5.72.2 ebgp-multihop '10'
set protocols bgp neighbor 10.5.72.2 remote-as 'XXX'
set protocols bgp neighbor 10.5.72.2 update-source 'dum1'
set protocols bgp neighbor 10.228.134.32 address-family ipv4-unicast prefix-list export 'SC-IPv4-OUT'
set protocols bgp neighbor 10.228.134.32 address-family ipv4-unicast route-map import 'SC-IPv4-IN'
set protocols bgp neighbor 10.228.134.32 address-family ipv4-unicast soft-reconfiguration inbound
set protocols bgp neighbor 10.228.134.32 description 'SC-x-1 vrf AAA'
set protocols bgp neighbor 10.228.134.32 remote-as '64516'
set protocols bgp neighbor 10.228.134.34 address-family ipv4-unicast prefix-list export 'SC-IPv4-OUT'
set protocols bgp neighbor 10.228.134.34 address-family ipv4-unicast route-map import 'SC-IPv4-IN'
set protocols bgp neighbor 10.228.134.34 address-family ipv4-unicast soft-reconfiguration inbound
set protocols bgp neighbor 10.228.134.34 description 'SC-x-2 vrf AAA'
set protocols bgp neighbor 10.228.134.34 remote-as '64516'
set protocols bgp neighbor 10.228.134.36 address-family ipv4-unicast prefix-list export 'SC-IPv4-OUT'
set protocols bgp neighbor 10.228.134.36 address-family ipv4-unicast route-map import 'SC-IPv4-IN'
set protocols bgp neighbor 10.228.134.36 address-family ipv4-unicast soft-reconfiguration inbound
set protocols bgp neighbor 10.228.134.36 description 'SC-x-1 vrf T2-LNS'
set protocols bgp neighbor 10.228.134.36 remote-as '64516'
set protocols bgp neighbor 10.228.134.38 address-family ipv4-unicast prefix-list export 'SC-IPv4-OUT'
set protocols bgp neighbor 10.228.134.38 address-family ipv4-unicast route-map import 'SC-IPv4-IN'
set protocols bgp neighbor 10.228.134.38 address-family ipv4-unicast soft-reconfiguration inbound
set protocols bgp neighbor 10.228.134.38 description 'SC-x-2 vrf T2-LNS'
set protocols bgp neighbor 10.228.134.38 remote-as '64516'
set protocols bgp neighbor 10.228.134.40 address-family ipv4-labeled-unicast route-map import 'IPCore-IPv4-LU-IN'
set protocols bgp neighbor 10.228.134.40 description 'BBR1 ipv4 LU'
set protocols bgp neighbor 10.228.134.40 remote-as 'XXX'
set protocols bgp neighbor 10.228.134.42 address-family ipv4-labeled-unicast route-map export 'IPCore-IPv4-LU-OUT'
set protocols bgp neighbor 10.228.134.42 address-family ipv4-labeled-unicast route-map import 'IPCore-IPv4-LU-IN'
set protocols bgp neighbor 10.228.134.42 address-family ipv4-labeled-unicast soft-reconfiguration inbound
set protocols bgp neighbor 10.228.134.42 description 'BBR2 ipv4 LU'
set protocols bgp neighbor 10.228.134.42 ebgp-multihop '10'
set protocols bgp neighbor 10.228.134.42 remote-as 'XXX'
set protocols bgp neighbor 10.228.134.101 address-family ipv4-vpn soft-reconfiguration inbound
set protocols bgp neighbor 10.228.134.101 description 'vLNS-4-1 VPNV4'
set protocols bgp neighbor 10.228.134.101 remote-as '64826'
set protocols bgp neighbor 10.228.134.101 update-source 'dum1'
set protocols bgp neighbor 10.228.134.102 address-family ipv4-unicast soft-reconfiguration inbound
set protocols bgp neighbor 10.228.134.102 description 'ipv4 vLNS-4-1 AAA/T2-LNS prefixes'
set protocols bgp neighbor 10.228.134.102 remote-as '64826'
set protocols bgp neighbor 10.228.134.102 update-source 'dum2'
set protocols bgp parameters log-neighbor-changes
set protocols bgp parameters router-id '10.228.134.1'
set protocols mpls interface 'eth4'
set protocols mpls interface 'eth5'
set protocols mpls interface 'eth6'
set protocols mpls interface 'eth3'
set protocols mpls ldp discovery hello-ipv4-interval '5'
set protocols mpls ldp discovery transport-ipv4-address '10.228.134.1'
set protocols mpls ldp interface 'eth5'
set protocols mpls ldp interface 'eth6'
set protocols mpls ldp router-id '10.228.134.1'
set protocols ospf interface dum0 area '0'
set protocols ospf interface dum0 passive
set protocols ospf interface dum1 area '0'
set protocols ospf interface dum1 passive
set protocols ospf interface dum2 area '0'
set protocols ospf interface dum2 passive
set protocols ospf interface eth5 area '0'
set protocols ospf interface eth5 network 'point-to-point'
set protocols ospf interface eth6 area '0'
set protocols ospf interface eth6 network 'point-to-point'
set protocols ospf log-adjacency-changes detail
set protocols ospf parameters router-id '10.228.134.1'
..
14

Also, seems I couldn`t sent you private message, because your user profile is hidden.

15

You can try two things:

  1. Remove communities from incoming prefixes, where possible:
    set policy route-map XXX rule XX set community 'none'
  2. Disable soft-reconfiguration inbound.

Maybe one of these changes will fix the problem.

I have no idea why private messages are not available - they are enabled in my profile and your user level is enough to send…

16

Thanks,
I`m going to remove ‘soft-reconfiguration inbound’ for all peers tonight and reload router after that (may be primary it has to be done for vpnv4-peers, as they have most of prefixes).

17

So,

I`ve removed ‘soft-reconfiguration inbound’ from all bgp-peers at 00:10:08 on Aug 12.

All neighbors have stayed just with only

set protocols bgp neighbor <neighbors ip_address> address-family soft-reconfiguration After that Ive reboot VyOS-router
After reboot VyOs, ‘top’ was like following:


00:20:47.451   admin@nn-vlns-3-1:~$ top
00:20:47.735   top - 00:20:37 up 5 min,  1 user,  load average: 0.13, 0.30, 0.17
00:20:47.736   Tasks: 153 total,   1 running, 152 sleeping,   0 stopped,   0 zombie
00:20:47.738   %Cpu(s):  0.0 us,  0.8 sy,  0.0 ni, 99.2 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
00:20:47.739   MiB Mem :  16020.0 total,  12192.7 free,   3529.2 used,    298.1 buff/cache
00:20:47.740   MiB Swap:      0.0 total,      0.0 free,      0.0 used.  12224.5 avail Mem 
00:20:47.740   
00:20:47.741       PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                                                
00:20:47.741       914 frr       15  -5  392748 217236   8252 S  12.5   1.3   0:17.09 bgpd

On that night I `ve also deleted community on received vpvn4-prefixes from IPcore-peers.

set policy route-map IPCore-vpnv4-IN rule 10 set community none

I restarted bgpd process after deleting community

And today`s top here is:

top - 13:06:25 up 3 days, 12:50,  1 user,  load average: 0.09, 0.07, 0.01
Tasks: 174 total,   1 running, 173 sleeping,   0 stopped,   0 zombie
%Cpu(s):  0.3 us,  0.3 sy,  0.0 ni, 99.3 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :  16019.9 total,  11116.1 free,   4588.0 used,    315.8 buff/cache
MiB Swap:      0.0 total,      0.0 free,      0.0 used.  11160.2 avail Mem 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                                                                                                               
   5285 frr       20   0 3052516   2.7g   6340 S   7.6  17.6 346:03.17 bgpd                                                                                                                  
   7890 admin     20   0   10148   3708   3184 R   0.7   0.0   0:00.02 top                                                                                                                   
     11 root      20   0       0      0      0 I   0.3   0.0   0:14.70 rcu_sched                                                                                                             
    912 root      15  -5    8436   3540   2276 S   0.3   0.0   3:32.46 watchfrr                                                                                                              
    978 frr       15  -5    9884   6816   5092 S   0.3   0.0   0:17.39 ldpd
18

I`ve resently opened task in phabricator, but there still without answers

https://phabricator.vyos.net/T4604

19

For whom it could be interesting ))

Sorry, I`ve just forgot to describe, if we were having succes with it or not
So, we implement for bbrs-vpnv4 neighbors

> set policy route-map IPCore-vpnv4-IN rule 10 action 'permit'
> set policy route-map IPCore-vpnv4-IN rule 10 set community 'none'
> 
> set protocols bgp neighbor <neighbor`s ip address> address-family ipv4-vpn route-map import 'IPCore-vpnv4-IN'

after that (and reboot LNS, for a case) - bgp still lives stable with following numbers of prefixes:

admin@nn-vlns-3-1:~$ sho bgp summary 

IPv4 Unicast Summary (VRF default):
BGP router identifier 10.228.134.1, local AS number 64826 vrf-id 0
BGP table version 3738
RIB entries 1620, using 304 KiB of memory
Peers 5, using 3617 KiB of memory

Neighbor        V         AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt Desc
10.228.134.32   4      64516    146672    147293        0    0    0 5d02h44m           55        4 SC-x-1 vrf AAA
10.228.134.34   4      64516    146680    147293        0    0    0 5d02h44m           55        4 SC-x-2 vrf AAA
10.228.134.36   4      64516    146729    147293        0    0    0 5d02h44m          200        4 SC-x-1 vrf T2-LNS
10.228.134.38   4      64516    146733    147293        0    0    0 5d02h44m          200        4 SC-x-2 vrf T2-LNS
10.228.134.102  4      64826      8395      8337        0    0    0 5d02h44m          254      867 ipv4 vLNS-4-1 AAA/T2

Total number of neighbors 5

IPv4 VPN Summary (VRF default):
BGP router identifier 10.228.134.1, local AS number 64826 vrf-id 0
BGP table version 0
RIB entries 2029, using 380 KiB of memory
Peers 3, using 2170 KiB of memory

Neighbor        V         AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt Desc
10.5.72.1       4      39374  33317370    392109        0    0    0 5d02h44m        41485     1294 BBR1 vpnv4
10.5.72.2       4      39374  33331215    392109        0    0    0 5d02h44m        41484     1294 BBR2 vpnv4
10.228.134.101  4      64826  22736670  22766438        0    0    0 5d02h44m        41492    42803 vLNS-4-1 VPNV4

Total number of neighbors 3

IPv4 Labeled Unicast Summary (VRF default):
BGP router identifier 10.228.134.1, local AS number 64826 vrf-id 0
BGP table version 3
RIB entries 5, using 960 bytes of memory
Peers 2, using 1447 KiB of memory

Neighbor        V         AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt Desc
10.228.134.40   4      39374     10143      7368        0    0    0 5d02h44m          613        4 BBR1 ipv4 LU
10.228.134.42   4      39374     10175      7368        0    0    0 5d02h44m          613        4 BBR2 ipv4 LU

Total number of neighbors 2
admin@nn-vlns-3-1:~$

and top:

admin@nn-vlns-3-1:~$ top 
top - 00:15:21 up 5 days,  2:58,  3 users,  load average: 0.31, 0.44, 0.43
Tasks: 154 total,   1 running, 153 sleeping,   0 stopped,   0 zombie
%Cpu(s):  3.1 us,  2.2 sy,  0.0 ni, 94.1 id,  0.2 wa,  0.0 hi,  0.3 si,  0.0 st
MiB Mem :  16017.2 total,   8954.2 free,   1971.4 used,   5091.6 buff/cache
MiB Swap:      0.0 total,      0.0 free,      0.0 used.  13695.8 avail Mem 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                                                
    904 frr       15  -5  846664 668792   6496 S  11.3   4.1 762:50.30 bgpd                                                   
    899 frr       15  -5  942120 193940   4552 S   9.3   1.2 514:51.68 zebra

5 days up - it was some needed reboot, didnt related to bgp memory problem.

For example, output from the LNS on other site, which UP at 47 days:

admin@nn-lns-4-1:~$ sho bgp summary 

IPv4 Unicast Summary (VRF default):
BGP router identifier 10.228.134.101, local AS number 64826 vrf-id 0
BGP table version 91180
RIB entries 1620, using 304 KiB of memory
Peers 5, using 3617 KiB of memory

Neighbor        V         AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt Desc
10.228.134.2    4      64826    131926    131973        0    0    0 5d02h50m          254      867 ipv4 vLNS-3-1 AAA/T2
10.228.134.132  4      64516   1343678   1349454        0    0    0 02w4d23h           55        4 SC-x-1 vrf AAA
10.228.134.134  4      64516   1344530   1350310        0    0    0 06w4d21h           55        4 SC-x-2 vrf AAA
10.228.134.136  4      64516   1343854   1349454        0    0    0 02w4d23h          200        4 SC-x-1 vrf T2-LNS
10.228.134.138  4      64516   1344670   1350311        0    0    0 06w4d21h          200        4 SC-x-2 vrf T2-LNS

Total number of neighbors 5

IPv4 VPN Summary (VRF default):
BGP router identifier 10.228.134.101, local AS number 64826 vrf-id 0
BGP table version 0
RIB entries 2777, using 521 KiB of memory
Peers 3, using 2170 KiB of memory

Neighbor        V         AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt Desc
10.5.72.3       4      39374 311830369    702997        0    0    0 06w4d21h        41493     1286 BBR3 vpnv4
10.5.72.4       4      39374 308961204    702997        0    1    0 06w4d21h        41489     1286 BBR4 vpnv4
10.228.134.1    4      64826 208498815 210760357        0    0    0 5d02h50m        42804    41499 vLNS-3-1 VPNV4

Total number of neighbors 3

IPv4 Labeled Unicast Summary (VRF default):
BGP router identifier 10.228.134.101, local AS number 64826 vrf-id 0
BGP table version 3
RIB entries 5, using 960 bytes of memory
Peers 2, using 1447 KiB of memory

Neighbor        V         AS   MsgRcvd   MsgSent   TblVer  InQ OutQ  Up/Down State/PfxRcd   PfxSnt Desc
10.228.134.140  4      39374    144826     67541        0    0    0 06w4d21h          613        4 BBR3 ipv4 LU
10.228.134.142  4      39374    144384     67541        0    0    0 06w4d21h          613        4 BBR4 ipv4 LU

Total number of neighbors 2
admin@nn-lns-4-1:~$   top
top - 00:21:16 up 47 days, 7 min,  1 user,  load average: 0.07, 0.06, 0.01
Tasks: 176 total,   1 running, 175 sleeping,   0 stopped,   0 zombie
%Cpu(s):  0.8 us,  0.5 sy,  0.0 ni, 98.6 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :  16017.1 total,  12680.3 free,   2121.6 used,   1215.2 buff/cache
MiB Swap:      0.0 total,      0.0 free,      0.0 used.  13604.3 avail Mem 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                                                
                                     
  11292 frr       20   0  425820 253184   6524 S   4.0   1.5   2711:25 bgpd

Many thanks for time and attention and help

BR,
Olev

20

This topic was automatically closed 2 days after the last reply. New replies are no longer allowed.