[Fedora QA] #72: Proposal for reducing test permutations

Fedora QA trac at fedorahosted.org
Tue Jul 27 20:37:04 UTC 2010

#72: Proposal for reducing test permutations
  Reporter:  rhe          |       Owner:  rhe      
      Type:  enhancement  |      Status:  new      
  Priority:  major        |   Milestone:  Fedora 14
 Component:  Test Review  |     Version:           
Resolution:               |    Keywords:           
Comment (by jlaska):

 Apologies, I missed your latest updates in this ticket.

 Replying to [comment:10 rhe]:
 > I further updated the
 [https://fedoraproject.org/wiki/User:Rhe/Draft2#Test_Matrix matrix], and
 I'm not sure if the following tests can be removed or not:
 >  * [https://fedoraproject.org/wiki/QA:Testcase_Boot_Methods_efidisk.img
 > Reason: Not commonly used and require special device to support it.

 I'd like to remove this test, but I'm afraid we need to ensure this is
 functional since it is included in the Beta release criteria
 (https://fedoraproject.org/wiki/Fedora_14_Beta_Release_Criteria).  I've
 relied on feedback from pjones in previous releases to run this test.
 Mainly because running this test is still a mystery to me.  I agree the
 conditions around this test are not ideal, but I don't have any great
 ideas for improving this right now :(

 >  * [https://fedoraproject.org/wiki/QA/TestCases/PartitioningNoSwap
 > Reason: I don't think No Swap should be separated as a test.

 This test still exists to target the dialog warning that swap is
 recommended.  What do you recommend, should this test be absorbed into
 another test?

 >  * [https://fedoraproject.org/wiki/QA/TestCases/KickstartKsFilePathKsCfg
 > Reason: Is it a usual way to load kickstart file? I seldom use this way.

 This is how preupgrade and snake delivery kickstarts.  They open up the
 initrd.img and insert the ks.cfg there.  We'll need to continue supporting

 >  *
 > Reason:
 QA:Testcase_Preupgrade_from_older_release] is already the case of low
 /boot disk space. And for upgrading from F13, 500M /boot is enough for

 Good point, this should be less of an issue preupgrading from F13 -> F14.
 The remaining preupgrade test is written to mimic a real-world upgrade
 scenario, so we should capture any /boot size issues as they surface.

 > What do you think? Please feel free to add comments and tell me if there
 are other tests in the removing list.

 I can't think of any others at this time.  Thanks!

Ticket URL: <https://fedorahosted.org/fedora-qa/ticket/72#comment:11>
Fedora QA <http://fedorahosted.org/fedora-qa>
Fedora Quality Assurance

More information about the test mailing list