Tunnels are failing randomaly on digital ocean droploet

General questions
1

Hi Team,

I had 7-8 tunnels configured on Digital ocean droplet and suddenly from last morning those are failing intermittently. Automatically those comes up in an hour or so.

When the tunnel is down I consistenly get a message

Jun  9 06:44:12 DR-VPN-X charon: 05[JOB] <3194> deleting half open IKE_SA with 143.244.x.x after timeout
Jun  9 06:45:00 DR-VPN-X charon: 05[JOB] <3202> deleting half open IKE_SA with 143.244.x.x after timeout
Jun  9 06:45:42 DR-VPN-X charon: 14[JOB] <3208> deleting half open IKE_SA with 143.244.x.x after timeout
Jun  9 06:48:27 DR-VPN-X charon: 13[JOB] <3230> deleting half open IKE_SA with 143.244.x.x after timeout
Jun  9 06:51:12 DR-VPN-X charon: 05[JOB] <3253> deleting half open IKE_SA with 143.244.x.x after timeout
Jun  9 06:54:01 DR-VPN-X charon: 06[JOB] <3275> deleting half open IKE_SA with 143.244.x.x after timeout
Jun  9 06:56:50 DR-VPN-X charon: 09[JOB] <3298> deleting half open IKE_SA with 143.244.x.x after timeout
Jun  9 06:59:35 DR-VPN-X charon: 12[JOB] <3320> deleting half open IKE_SA with 143.244.x.x after timeout
Jun  9 07:02:20 DR-VPN-X charon: 12[JOB] <3342> deleting half open IKE_SA with 143.244.x.x after timeout
Jun  9 07:05:09 DR-VPN-X charon: 08[JOB] <3366> deleting half open IKE_SA with 143.244.x.x after timeout
Jun  9 07:08:06 DR-VPN-X charon: 08[JOB] <3389> deleting half open IKE_SA with 143.244.x.x after timeout
Jun  9 07:10:51 DR-VPN-X charon: 13[JOB] <3412> deleting half open IKE_SA with 143.244.x.x after timeout
Jun  9 07:13:36 DR-VPN-X charon: 08[JOB] <3434> deleting half open IKE_SA with 143.244.x.x after timeout
Jun  9 07:16:45 DR-VPN-X charon: 15[JOB] <3459> deleting half open IKE_SA with 143.244.x.x after timeout

However few tunnels remain up but few tunnels are consistently going down.

2

The thing to note here is; I can ping to the 143.244.x.x from my other peer and ICMP is no issue at all. Any debug or help is much appreciated.

3

Can you please share the VyOS version, device full configuration and also the charon.log (to generate the file run the command $journalctl -b /usr/lib/ipsec/charon > charon.log)

4

The version is 1.2.8 and logs I am sending you to personal since it has lot of vital information?

5

Have sent the logs to you in a private message. The issue started occurring from 8th Jun around 12.30

6

Are both peers configured as initiators ? or one peer 143.244.x.x as initiator and the other as responder ? What is the authentication mode ? Have you done any changes to the configuration ? Are both the VMs installed with VyOS ?
Share the output of the following command:

$ sudo swanctl -l
$ sudo swanctl -P
$ sudo swanctl -L