[Test-Announce] Call for reviewing TCMS use cases and comparison!

[Adam Williamson]

On Fri, 2011-01-21 at 19:02 +0000, Samuel Greenfeld wrote:

>         > I do like litmus!  It's a nice evolution from testopia for
>         upstream
>         > mozilla.  We don't currently have an 'unclear' test result.
>          I'm not
>         > opposed to it, but would need better understand how that
>         field is used,
>         > and the process around it, in litmus.
>         
>         
>         Agree with James.
> 
> What I believe Mozilla is doing (since I have not had a chance to work
> with their QA team yet) is flagging test cases with a form of soft
> failure in that the result of a testcase neither clearly passed, nor
> clearly failed.  So in addition to "Passed", "Failed", and any other
> common states (Blocked, In Progress, etc.) you have an "Unclear"
> result state.

Hurry is somewhat wrong to say we don't currently have an 'unclear'
result; we do have the 'warn' result, which is in some ways similar. We
usually use it to indicate when a test turns up some kind of anomalous
behaviour which isn't exactly a failure.
-- 
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Fedora Talk: adamwill AT fedoraproject DOT org
http://www.happyassassin.net