Hello,
the testing system is required to inspect the exit code of the test suite
[1]:
To invoke the playbook, the *testing system*:
6. MUST examine the exit code of the playbook. A zero exit code is
successful *test result*, non-zero is failure.
However, the test suite is not required to return the correct exit code.
Under
The playbook and its *test suite* or *test framework*:
there is no mention of returning the exit code. I think that should be
clarified, because it can be expected that people implementing SI will only
read those parts relevant for them. I believe this should be added:
The playbook and its *test suite* or *test framework*:
> 6. MUST return a zero exit code of the playbook if the test result is a
> pass, or a non-zero exit code if the test result is a fail.
>
Thoughts?
[1]
https://fedoraproject.org/wiki/Changes/InvokingTests