Hey, hate to bother you again, but I’m still having issues with smoke tests. I’ll intend to keep this thread as general as possible to tackle all issues until smoketests are finally running again.
So this time I’m truggeling with VRP tests, which are all failing when executed via vyos_build docker container using make test. I’ve created a ticket about this issue (here) and tried to have a look at recent code changes, ensuring this is not a recent recession. I’m not yet that deep into bisecting, so I didn’t get too far (and found nothing suspicious).
Besides fixing the underlying issue, I’d love to know how I should treat these failures in regards to self built images. We had to resort to that due to the removal of qemu-guest-agent from the rolling builds, which itself is perfectly fine. But as I never got an image to build with no tests failing, I wonder how the tests are performed for the actual available rolling .iso? As far as I understood the smoke tests are mandatory to be passed before a new release is published? So either I’m doing something terribly wrong (even though my recently encountered failures got fixed in code, not by change of procedure), or I’ve got the “smoke tests passing is mandatory for rolling release publishing” part completely wrong.
As usual, best regards!