A quick look over your config looks good. You are on the right track that you need to use different distance metrics on your router to address the connectivity issue. To answer your question about the Source NAT, your NAT rules specify outbound interface, source address, and translation address; so yes, VyOS will know which WAN IP goes to which subnet when you switch between ISPs.
I would suggest configuring WAN Load-Balance to give you system better management options for load balancing (with health tests). Then the static routes will only be used by the local router. I ran into a similar issue when trying to address inbound traffic issues with Load Balanced ISPs. See my thread here for some notes and ideas.
I need to look over your config more, but I would also suggest if you’re going to go to the effort of setting up network and/or port groups, use them in your firewall instead of re-entering the same ports. And this is a personal choice, but if you don’t need to have separate firewalls for specific interfaces, use single firewalls like WAN-LOCAL and WAN-LAN instead of creating the same rules on multiple firewalls because you have more than 1 ISP. Then you can simplify and 1 change will help when the ISPs failover.