[Fedora QA] #85: Clarify wiki test priority

Fedora QA trac at fedorahosted.org
Wed Jun 23 19:31:40 UTC 2010


#85: Clarify wiki test priority
---------------------------+------------------------------------------------
 Reporter:  jlaska         |       Owner:           
     Type:  enhancement    |      Status:  new      
 Priority:  major          |   Milestone:  Fedora 14
Component:  Wiki           |     Version:           
 Keywords:  retrospective  |  
---------------------------+------------------------------------------------
 = problem =

 There was some confusing around the priority listed in the install and
 desktop test matrices.  The question was, why do we give the ''go''
 decision to release, even when there are test failures from tests with a
 matching release level?

 = analysis =

 Adam pointed out that ''this is because the bugs exposed caused the test
 to 'fail', but don't really break the underlying release criteria. I think
 we could perhaps track this type of 'failure' specifically in the results
 tables).''

 = enhancement recommendation =

 I ''think'' this is a messaging/education issue.  Perhaps we just need to
 clarify that the priority listed is the test execution priority.  It does
 not always mean that a failure identified by those tests will block the
 applicable release.

 Updates or adjustments may be needed to the
 https://fedoraproject.org/wiki/QA/SOP_Release_Validation_Test_Event or to
 the Fedora 14 test results template (when available --
 https://fedoraproject.org/wiki/QA:Fedora_14_Install_Results_Template).

-- 
Ticket URL: <https://fedorahosted.org/fedora-qa/ticket/85>
Fedora QA <http://fedorahosted.org/fedora-qa>
Fedora Quality Assurance


More information about the test mailing list