On Fri, 2011-01-21 at 19:02 +0000, Samuel Greenfeld wrote:
> I do like litmus! It's a nice evolution from
testopia for
upstream
> mozilla. We don't currently have an 'unclear' test result.
I'm not
> opposed to it, but would need better understand how that
field is used,
> and the process around it, in litmus.
Agree with James.
What I believe Mozilla is doing (since I have not had a chance to work
with their QA team yet) is flagging test cases with a form of soft
failure in that the result of a testcase neither clearly passed, nor
clearly failed. So in addition to "Passed", "Failed", and any other
common states (Blocked, In Progress, etc.) you have an "Unclear"
result state.
Hurry is somewhat wrong to say we don't currently have an 'unclear'
result; we do have the 'warn' result, which is in some ways similar. We
usually use it to indicate when a test turns up some kind of anomalous
behaviour which isn't exactly a failure.
--
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Fedora Talk: adamwill AT fedoraproject DOT org
http://www.happyassassin.net