[Fedora QA] #363: Require spins to go through smoke testing before being published

[fedora-badges]

#363: Require spins to go through smoke testing before being published
-------------------------+----------------------------------
 Reporter:  adamwill     |       Owner:
     Type:  enhancement  |      Status:  new
 Priority:  minor        |   Milestone:  Undetermined Future
Component:  Test cases   |     Version:
 Keywords:               |  Blocked By:
 Blocking:               |
-------------------------+----------------------------------
 = problem =

 Sometimes, we publish spins that are completely DOA.

 = analysis =

 There is no mandatory testing of any Fedora images beyond netinst, DVD and
 the two release blocking desktop live spins, as things stand, but we
 publish rather more spins than that. In practice we test Xfce, LXDE, SoaS
 and AMI images to some extent, but others are rarely touched.

 = enhancement recommendation =

 viking-ice has suggested that we should produce some kind of validation
 matrix which has very basic, generic smoke tests: basically, does the
 image at least boot up sanely? We would require there to be a PASS for
 these mandatory smoke tests present in that matrix for a spin image to be
 published on the spins page. QA does not commit to doing the actual
 testing; we may do so if we have time, but ultimately, if a spin owner
 wants to have their spin published, it's their responsibility to get the
 testing done, either by poking QA, doing it themselves, or getting someone
 else to do it.

-- 
Ticket URL: <https://fedorahosted.org/fedora-qa/ticket/363>
Fedora QA <http://fedorahosted.org/fedora-qa>
Fedora Quality Assurance

[fedora-badges]

#363: Require spins to go through smoke testing before being published
--------------------------+---------------------------------
  Reporter:  adamwill     |      Owner:
      Type:  enhancement  |     Status:  closed
  Priority:  minor        |  Milestone:  Undetermined Future
 Component:  Test cases   |    Version:
Resolution:  worksforme   |   Keywords:
Blocked By:               |   Blocking:
--------------------------+---------------------------------
Changes (by adamwill):

 * resolution:   => worksforme
 * status:  new => closed


Comment:

 This has more or less been implemented by releng; releng now drops spins
 that haven't been affirmed to pass smoke testing for a cycle.

-- 
Ticket URL: <https://fedorahosted.org/fedora-qa/ticket/363#comment:1>
Fedora QA <http://fedorahosted.org/fedora-qa>
Fedora Quality Assurance