IMPORTANT, please read: Spins QA signoff for milestones

[Kevin Fenzi]

Per: 

https://fedorahosted.org/fesco/ticket/1171

I have added a set of cols to the spins page for f20: 

https://fedoraproject.org/w/index.php?title=Releases%2F20%2FSpins&dif...

One each for "Alpha" "Beta" and "Final"

kde and desktop are release blocking so they will always be shipped, so
I put 'yes' for them for all milestones. 

Please update this table when/if you test a TC/RC version of a spin for
a milestone. I'll also try and go update it based on other tests in
the wiki as we go on. I updated Xfce Alpha as I tested TC4 with it (and
intend to test rc's as well).

It's important to keep this up to date so we know what spins to ship
for a milestone. If you are a spin owner and don't have time to test,
please try and line up some folks to test for you. 

You will need at least one person to test or your spin will not be
shipped for that milestone. 

Thanks, 

kevin

[Amit Saha]

Hi Kevin,

----- Original Message -----
>  From: "Kevin Fenzi" <kevin(a)scrye.com&gt;
>  To: spins(a)lists.fedoraproject.org, devel(a)lists.fedoraproject.org,
> test(a)lists.fedoraproject.org
>  Sent: Wednesday, September 11, 2013 5:00:26 AM
>  Subject: [Fedora-spins] IMPORTANT,	please read: Spins QA signoff for milestones
>  
>  Per:
>  
>  https://fedorahosted.org/fesco/ticket/1171
>  
>  I have added a set of cols to the spins page for f20:
>  
>
> https://fedoraproject.org/w/index.php?title=Releases%2F20%2FSpins&dif...
>  
>  One each for "Alpha" "Beta" and "Final"
>  
>  kde and desktop are release blocking so they will always be shipped, so
>  I put 'yes' for them for all milestones.
>  
>  Please update this table when/if you test a TC/RC version of a spin for
>  a milestone. I'll also try and go update it based on other tests in
>  the wiki as we go on. I updated Xfce Alpha as I tested TC4 with it (and
>  intend to test rc's as well). 
Is it sufficient to install the ISO on baremetal/VM and do some basic testing 
of the applications?

Thanks,
Amit

-- 
Amit Saha <http://echorand.me>

[Kevin Fenzi]

On Tue, 10 Sep 2013 17:59:29 -0400 (EDT)
Amit Saha <asaha(a)redhat.com&gt; wrote:

>  Hi Kevin,
>
>  Is it sufficient to install the ISO on baremetal/VM and do some basic
>  testing of the applications? 
Yep. All we are looking for are the basic tests. 

Does it compose? 

Does it boot? 

Do things work after it boots?

Does it install ?

Do things work after the install?

kevin

[Ian Malone]

On 10 September 2013 23:31, Kevin Fenzi <kevin(a)scrye.com&gt; wrote:
>  On Tue, 10 Sep 2013 17:59:29 -0400 (EDT)
>  Amit Saha <asaha(a)redhat.com&gt; wrote:
>
> > Hi Kevin,
> >
> > Is it sufficient to install the ISO on baremetal/VM and do some basic
> > testing of the applications?
>
>  Yep. All we are looking for are the basic tests.
>
>  Does it compose?
>
>  Does it boot?
>
>  Do things work after it boots?
>
>  Does it install ?
>
>  Do things work after the install?
>  
Do spins fill in their own test matrix or on the main test compose
page? (I'm guessing the former since spin testers aren't necessarily
on the main QA team.)

(possibly not subscribed to the test list, so this mail may bounce there.)

-- 
imalone
http://ibmalone.blogspot.co.uk

[Kevin Fenzi]

On Wed, 11 Sep 2013 00:20:31 +0100
Ian Malone <ibmalone(a)gmail.com&gt; wrote:

>  On 10 September 2013 23:31, Kevin Fenzi <kevin(a)scrye.com&gt;
> wrote:
>  > On Tue, 10 Sep 2013 17:59:29 -0400 (EDT)
>  > Amit Saha <asaha(a)redhat.com&gt; wrote:
>  >
>  >> Hi Kevin,
>  >>
>  >> Is it sufficient to install the ISO on baremetal/VM and do some
>  >> basic testing of the applications?
>  >
>  > Yep. All we are looking for are the basic tests.
>  >
>  > Does it compose?
>  >
>  > Does it boot?
>  >
>  > Do things work after it boots?
>  >
>  > Does it install ?
>  >
>  > Do things work after the install?
>  >
>  
>  Do spins fill in their own test matrix or on the main test compose
>  page? (I'm guessing the former since spin testers aren't necessarily
>  on the main QA team.)
>  
>  (possibly not subscribed to the test list, so this mail may bounce
>  there.) 
Well, for the 'desktop' spins, there is already: 

https://fedoraproject.org/wiki/Test_Results:Fedora_20_Alpha_TC5_Desktop#N...

We could look at adding for other spins, or just do other tests as that
spin needs. 

Really what I want to prevent is us shipping something thats just
obviously broken (as we have many times with spins in recent years). 

kevin

[Amit Saha]

----- Original Message -----
>  From: "Kevin Fenzi" <kevin(a)scrye.com&gt;
>  To: "The Spin Special Interest Group mailing list"
> <spins(a)lists.fedoraproject.org&gt;
>  Cc: ibmalone(a)gmail.com, test(a)lists.fedoraproject.org
>  Sent: Wednesday, September 11, 2013 9:53:50 AM
>  Subject: Re: [Fedora-spins] IMPORTANT, please read: Spins QA signoff for	milestones
>  
>  On Wed, 11 Sep 2013 00:20:31 +0100
>  Ian Malone <ibmalone(a)gmail.com&gt; wrote:
>  
>  > On 10 September 2013 23:31, Kevin Fenzi <kevin(a)scrye.com&gt; wrote:
>  > > On Tue, 10 Sep 2013 17:59:29 -0400 (EDT)
>  > > Amit Saha <asaha(a)redhat.com&gt; wrote:
>  > >
>  > >> Hi Kevin,
>  > >>
>  > >> Is it sufficient to install the ISO on baremetal/VM and do some
>  > >> basic testing of the applications?
>  > >
>  > > Yep. All we are looking for are the basic tests.
>  > >
>  > > Does it compose?
>  > >
>  > > Does it boot?
>  > >
>  > > Do things work after it boots?
>  > >
>  > > Does it install ?
>  > >
>  > > Do things work after the install?
>  > >
>  > 
>  > Do spins fill in their own test matrix or on the main test compose
>  > page? (I'm guessing the former since spin testers aren't necessarily
>  > on the main QA team.)
>  > 
>  > (possibly not subscribed to the test list, so this mail may bounce
>  > there.)
>  
>  Well, for the 'desktop' spins, there is already:
>  
>
> https://fedoraproject.org/wiki/Test_Results:Fedora_20_Alpha_TC5_Desktop#N...
>  
>  We could look at adding for other spins, or just do other tests as that
>  spin needs.
>  
>  Really what I want to prevent is us shipping something thats just
>  obviously broken (as we have many times with spins in recent years). 
 
I started something like that for the Fedora Scientific Spin [1].
Is that going to be useful?

[1] http://fedoraproject.org/wiki/Scientific_Packages_Testing

-Amit.


-- 
Amit Saha <http://echorand.me>

[Ian Malone]

On 11 September 2013 01:22, Amit Saha <asaha(a)redhat.com&gt; wrote:
>  ----- Original Message -----
> > From: "Kevin Fenzi" <kevin(a)scrye.com&gt;
> > To: "The Spin Special Interest Group mailing list"
> <spins(a)lists.fedoraproject.org&gt;
> > Cc: ibmalone(a)gmail.com, test(a)lists.fedoraproject.org
> > Sent: Wednesday, September 11, 2013 9:53:50 AM
> > Subject: Re: [Fedora-spins] IMPORTANT, please read: Spins QA signoff for     
> milestones
> >
> > On Wed, 11 Sep 2013 00:20:31 +0100
> > Ian Malone <ibmalone(a)gmail.com&gt; wrote: 
> > > Do spins fill in their own test matrix or on the main test
> compose
> > > page? (I'm guessing the former since spin testers aren't necessarily
> > > on the main QA team.)
> > > 
> >
> > Well, for the 'desktop' spins, there is already:
> >
> >
> https://fedoraproject.org/wiki/Test_Results:Fedora_20_Alpha_TC5_Desktop#N...
> >
> > We could look at adding for other spins, or just do other tests as that
> > spin needs.
> >
> > Really what I want to prevent is us shipping something thats just
> > obviously broken (as we have many times with spins in recent years).
>
>  I started something like that for the Fedora Scientific Spin [1].
>  Is that going to be useful?
>
>  [1] http://fedoraproject.org/wiki/Scientific_Packages_Testing
>  
Thanks to you both, I think those are helpful.

-- 
imalone
http://ibmalone.blogspot.co.uk

[Kevin Fenzi]

On Tue, 10 Sep 2013 20:22:38 -0400 (EDT)
Amit Saha <asaha(a)redhat.com&gt; wrote:

>  I started something like that for the Fedora Scientific Spin [1].
>  Is that going to be useful?
>  
>  [1] http://fedoraproject.org/wiki/Scientific_Packages_Testing 
Yes, that is a good start. ;) 

The basic desktop tests would be good to run on most spins... check
that you can login, menu's work, browser works, you can get updates,
etc. 

kevin

[Amit Saha]

----- Original Message -----
>  From: "Kevin Fenzi" <kevin(a)scrye.com&gt;
>  To: "The Spin Special Interest Group mailing list"
> <spins(a)lists.fedoraproject.org&gt;
>  Cc: test(a)lists.fedoraproject.org
>  Sent: Wednesday, September 11, 2013 8:31:30 AM
>  Subject: Re: [Fedora-spins] IMPORTANT, please read: Spins QA signoff for	milestones
>  
>  On Tue, 10 Sep 2013 17:59:29 -0400 (EDT)
>  Amit Saha <asaha(a)redhat.com&gt; wrote:
>  
>  > Hi Kevin,
>  >
>  > Is it sufficient to install the ISO on baremetal/VM and do some basic
>  > testing of the applications?
>  
>  Yep. All we are looking for are the basic tests.
>  
>  Does it compose?
>  
>  Does it boot?
>  
>  Do things work after it boots?
>  
>  Does it install ?
>  
>  Do things work after the install? 

Thanks, sounds good.

-- 
Amit Saha <http://echorand.me>

[Luya Tshimbalanga]

On 10/09/13 12:00 PM, Kevin Fenzi wrote:
>  Per:
>
>  https://fedorahosted.org/fesco/ticket/1171
>
>  I have added a set of cols to the spins page for f20:
>
>
> https://fedoraproject.org/w/index.php?title=Releases%2F20%2FSpins&dif...
>
>  One each for "Alpha" "Beta" and "Final"
>
>  kde and desktop are release blocking so they will always be shipped, so
>  I put 'yes' for them for all milestones.
>
>  
In my case, Design Suite is based on desktop spin.
I succesfully tested the nightly 20130904 with both USB and Gnome Boxes.
Only issue with failed built in nightly-compose comes from desktop spin 
i.e. rdesktop.

Luya

[Kevin Fenzi]

On Tue, 10 Sep 2013 16:07:31 -0700
Luya Tshimbalanga <luya(a)fedoraproject.org&gt; wrote:

>  On 10/09/13 12:00 PM, Kevin Fenzi wrote:
>  > Per:
>  >
>  > https://fedorahosted.org/fesco/ticket/1171
>  >
>  > I have added a set of cols to the spins page for f20:
>  >
>  >
> https://fedoraproject.org/w/index.php?title=Releases%2F20%2FSpins&dif...
>  >
>  > One each for "Alpha" "Beta" and "Final"
>  >
>  > kde and desktop are release blocking so they will always be
>  > shipped, so I put 'yes' for them for all milestones.
>  >
>  >
>  In my case, Design Suite is based on desktop spin. 
Fine, but please do test your spin too. 

>  I succesfully tested the nightly 20130904 with both USB and Gnome
>  Boxes. Only issue with failed built in nightly-compose comes from
>  desktop spin i.e. rdesktop. 
Please test the TC (test compose)es or RC(release composes): 
http://dl.fedoraproject.org/pub/alt/stage/20-Alpha-TC5/Spins/
(RC1 should be out later tonight/tomorrow morning). 

kevin

[Dan Mashal]

On Tue, Sep 10, 2013 at 12:00 PM, Kevin Fenzi <kevin(a)scrye.com&gt; wrote:
>  Per:
>
>  https://fedorahosted.org/fesco/ticket/1171
>
>  I have added a set of cols to the spins page for f20:
>
>
> https://fedoraproject.org/w/index.php?title=Releases%2F20%2FSpins&dif...
>
>  One each for "Alpha" "Beta" and "Final"
>
>  kde and desktop are release blocking so they will always be shipped, so
>  I put 'yes' for them for all milestones.
>
>  Please update this table when/if you test a TC/RC version of a spin for
>  a milestone. I'll also try and go update it based on other tests in
>  the wiki as we go on. I updated Xfce Alpha as I tested TC4 with it (and
>  intend to test rc's as well).
>
>  It's important to keep this up to date so we know what spins to ship
>  for a milestone. If you are a spin owner and don't have time to test,
>  please try and line up some folks to test for you.
>
>  You will need at least one person to test or your spin will not be
>  shipped for that milestone. 
Just an FYI for everyone... target size for MATE spin will probably
change (to <=1000MB). While I haven't had a chance to test I will get
someone (besides myself) to test. In regards to the size, I have not
changed a thing so I'll try to look deeper into it later (currently
not really able to work on it )... it's not a deal breaker for the
spin just a NTH and again this is just an FYI so everyone knows.

Dan