Found out that a password like “test$#123” is accepted but not working afterwards.
set system login user vyos authentication plaintext-password test$#123
can be saved without any complains, but will not be working for login afterwards.
The problem in this example seems to be the “$#”