[PATCH] SPEC: Print testsuite log for failed test

[Lukas Slebodnik]

ehlo,

Starting from Automake 1.13, the parallel testsuite harness has been made
the default one; this harness is quite silent.

VERBOSE=yes will displays the logs of the non-passed tests (i.e., only
of the failed or skipped ones, or of the ones that passed unexpectedly).

How to test:
It need to be tested with failed test. The easist reproducer is to revert
commit 09a36be00ddcf1d7bd5b8a368143d5b2e2f4fb68.

Without attached patch, you will see just summary.
e.g
============================================================================
Testsuite summary for sssd 1.12.2
============================================================================
# TOTAL: 50
# PASS:  49
# SKIP:  0
# XFAIL: 0
# FAIL:  1
# XPASS: 0
# ERROR: 0
============================================================================
See ./test-suite.log
Please report to [e-mail]
============================================================================

With attached test, you will also see the output from failed test.

LS

[Jakub Hrozek]

On Thu, Oct 16, 2014 at 09:03:57PM +0200, Lukas Slebodnik wrote:
> ehlo,
>
> Starting from Automake 1.13, the parallel testsuite harness has been made
> the default one; this harness is quite silent.
>
> VERBOSE=yes will displays the logs of the non-passed tests (i.e., only
> of the failed or skipped ones, or of the ones that passed unexpectedly).
>
> How to test:
> It need to be tested with failed test. The easist reproducer is to revert
> commit 09a36be00ddcf1d7bd5b8a368143d5b2e2f4fb68.
>
> Without attached patch, you will see just summary.
> e.g
> ============================================================================
> Testsuite summary for sssd 1.12.2
> ============================================================================
> # TOTAL: 50
> # PASS:  49
> # SKIP:  0
> # XFAIL: 0
> # FAIL:  1
> # XPASS: 0
> # ERROR: 0
>
> See ./test-suite.log
> Please report to [e-mail]
> ============================================================================
>
> With attached test, you will also see the output from failed test.
>
> LS

I agree this would be useful for downstreams and I don't really see any
disadvantage, so..ACK!

[Jakub Hrozek]

On Wed, Oct 22, 2014 at 04:27:47PM +0200, Jakub Hrozek wrote:
> On Thu, Oct 16, 2014 at 09:03:57PM +0200, Lukas Slebodnik wrote:
> > ehlo,
> >
> > Starting from Automake 1.13, the parallel testsuite harness has been made
> > the default one; this harness is quite silent.
> >
> > VERBOSE=yes will displays the logs of the non-passed tests (i.e., only
> > of the failed or skipped ones, or of the ones that passed unexpectedly).
> >
> > How to test:
> > It need to be tested with failed test. The easist reproducer is to revert
> > commit 09a36be00ddcf1d7bd5b8a368143d5b2e2f4fb68.
> >
> > Without attached patch, you will see just summary.
> > e.g
> > ============================================================================
> > Testsuite summary for sssd 1.12.2
> > ============================================================================
> > # TOTAL: 50
> > # PASS:  49
> > # SKIP:  0
> > # XFAIL: 0
> > # FAIL:  1
> > # XPASS: 0
> > # ERROR: 0
> >
> > See ./test-suite.log
> > Please report to [e-mail]
> > ============================================================================
> >
> > With attached test, you will also see the output from failed test.
> >
> > LS
>
> I agree this would be useful for downstreams and I don't really see any
> disadvantage, so..ACK!

* master: 9ec9f2dd850eef9e124f9064121e1909230a9888