Hello,
Do you have DNS forwarding configured? Because it will already listen on port 53 which will prevent this container from also listening on that port. You will also need net-bind-service to bind to a privileged port so I am confused that it works for port 80.
set container name adguardhome cap-add net-bind-service
I personally struggled a bit with getting containers to listen to privileges ports. What I did instead is that I configured a non-standard DNS port as the listening port for my container, and configured the DNS forwarding to go to that instead and all my DNS clients would consume DNS from VyOS VLAN interface instead.
To see if something else is listening on that port you can use netstat:
sudo netstat -ntulp
My configuration can be seen in another forum post: Encrypt DNS requests to WAN - #2 by jagekurt