Facing issue with BGP, any idea what could be the issue?

Nah - not much; Do you notice anything?

show ip bgp neighbors 169.254.21.1
BGP neighbor is 169.254.21.1, remote AS 65515, local AS 65506, external link
  BGP version 4, remote router ID 10.11.44.132, local router ID 111.125.226.237
  BGP state = Established, up for 00:28:05
  Last read 00:00:00, Last write 00:00:05
  Hold time is 30, keepalive interval is 10 seconds
  Configured hold time is 30, keepalive interval is 10 seconds
  Neighbor capabilities:
    4 Byte AS: advertised and received
    AddPath:
      IPv4 Unicast: RX advertised IPv4 Unicast
    Route refresh: advertised and received(new)
    Address Family IPv4 Unicast: advertised and received
    Address Family IPv6 Unicast: received
    Hostname Capability: advertised (name: isn-mum-vpnx-wai,domain name: n/a) not received
    Graceful Restart Capabilty: advertised and received
      Remote Restart timer is 120 seconds
      Address families by peer:
        IPv4 Unicast(not preserved)
  Graceful restart information:
    End-of-RIB send: IPv4 Unicast
    End-of-RIB received:
  Message statistics:
    Inq depth is 0
    Outq depth is 0
                         Sent       Rcvd
    Opens:                551        422
    Notifications:        160        126
    Updates:             4014       1269
    Keepalives:       1124235    1281455
    Route Refresh:          6         19
    Capability:             0          0
    Total:            1128966    1283291
  Minimum time between advertisement runs is 0 seconds
  Update source is 169.254.21.13

 For address family: IPv4 Unicast
  Update group 1324, subgroup 1409
  Packet Queue length 0
  Inbound soft reconfiguration allowed
  Community attribute sent to this neighbor(all)
  Inbound path policy configured
  Route map for incoming advertisements is *accept-only-s4
  2 accepted prefixes

  Connections established 418; dropped 417
  Last reset 06:26:17,  Waiting for peer OPEN
Local host: 169.254.21.13, Local port: 40661
Foreign host: 169.254.21.1, Foreign port: 179
Nexthop: 169.254.21.13
Nexthop global: fe80::200:5efe:6f7d:e2ed
Nexthop local: fe80::200:5efe:6f7d:e2ed
BGP connection: non shared network
BGP Connect Retry Timer in Seconds: 120
Estimated round trip time: 15 ms
Read thread: on  Write thread: on  FD used: 30
 show ip bgp neighbors 169.254.22.1
BGP neighbor is 169.254.22.1, remote AS 65515, local AS 65506, external link
  BGP version 4, remote router ID 10.11.44.133, local router ID 111.125.226.237
  BGP state = Established, up for 00:28:10
  Last read 00:00:05, Last write 00:00:10
  Hold time is 30, keepalive interval is 10 seconds
  Configured hold time is 30, keepalive interval is 10 seconds
  Neighbor capabilities:
    4 Byte AS: advertised and received
    AddPath:
      IPv4 Unicast: RX advertised IPv4 Unicast
    Route refresh: advertised and received(new)
    Address Family IPv4 Unicast: advertised and received
    Address Family IPv6 Unicast: received
    Hostname Capability: advertised (name: isn-mum-vpnx-wai,domain name: n/a) not received
    Graceful Restart Capabilty: advertised and received
      Remote Restart timer is 120 seconds
      Address families by peer:
        IPv4 Unicast(not preserved)
  Graceful restart information:
    End-of-RIB send: IPv4 Unicast
    End-of-RIB received:
  Message statistics:
    Inq depth is 0
    Outq depth is 0
                         Sent       Rcvd
    Opens:               1189       1016
    Notifications:       1258         30
    Updates:             2543       3564
    Keepalives:       1091644    1242044
    Route Refresh:          6         18
    Capability:             0          0
    Total:            1096640    1246672
  Minimum time between advertisement runs is 0 seconds
  Update source is 169.254.21.9

 For address family: IPv4 Unicast
  Update group 1323, subgroup 1408
  Packet Queue length 0
  Inbound soft reconfiguration allowed
  Community attribute sent to this neighbor(all)
  Outbound path policy configured
  Route map for outgoing advertisements is *low-pref-vodafone
  4 accepted prefixes

  Connections established 1009; dropped 1008
  Last reset 06:26:45,  Waiting for peer OPEN
Local host: 169.254.21.9, Local port: 42473
Foreign host: 169.254.22.1, Foreign port: 179
Nexthop: 169.254.21.9
Nexthop global: fe80::200:5efe:2a68:616e
Nexthop local: fe80::200:5efe:2a68:616e
BGP connection: non shared network
BGP Connect Retry Timer in Seconds: 120
Estimated round trip time: 14 ms
Read thread: on  Write thread: on  FD used: 27