Hello,

the testing system is required to inspect the exit code of the test suite [1]:

To invoke the playbook, the testing system:
6. MUST examine the exit code of the playbook. A zero exit code is successful test result, non-zero is failure.

However, the test suite is not required to return the correct exit code. Under

The playbook and its test suite or test framework:

there is no mention of returning the exit code. I think that should be clarified, because it can be expected that people implementing SI will only read those parts relevant for them. I believe this should be added:

The playbook and its test suite or test framework:

6. MUST return a zero exit code of the playbook if the test result is a pass, or a non-zero exit code if the test result is a fail.

Thoughts?


[1] https://fedoraproject.org/wiki/Changes/InvokingTests