[Test-Announce] Call for reviewing TCMS use cases and comparison!

Adam Williamson awilliam at redhat.com
Tue Jan 25 07:05:19 UTC 2011

On Fri, 2011-01-21 at 19:02 +0000, Samuel Greenfeld wrote:

>         > I do like litmus!  It's a nice evolution from testopia for
>         upstream
>         > mozilla.  We don't currently have an 'unclear' test result.
>          I'm not
>         > opposed to it, but would need better understand how that
>         field is used,
>         > and the process around it, in litmus.
>         Agree with James.
> What I believe Mozilla is doing (since I have not had a chance to work
> with their QA team yet) is flagging test cases with a form of soft
> failure in that the result of a testcase neither clearly passed, nor
> clearly failed.  So in addition to "Passed", "Failed", and any other
> common states (Blocked, In Progress, etc.) you have an "Unclear"
> result state.

Hurry is somewhat wrong to say we don't currently have an 'unclear'
result; we do have the 'warn' result, which is in some ways similar. We
usually use it to indicate when a test turns up some kind of anomalous
behaviour which isn't exactly a failure.
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Fedora Talk: adamwill AT fedoraproject DOT org

More information about the test mailing list