Proposal: Rawhide installation validation testing

[Adam Williamson]

Hi folks!

Kamil Paral had a good suggestion which I've offered to take forward.
The Fedora 21 schedule means that we won't hit Alpha TC1 for another
three months or so (early July, on current lines). We thought it would
be a good idea to run some periodic formal validation tests in the mean
time, just to try and keep on top of major issues in Rawhide so we don't
wind up finding out in July that a whole bunch of stuff is broken.

So the idea is that we'll put up the usual set of validation test
matrices maybe once a month from here on out (or if this turns out to be
popular, we could make it more regular). This is just 'extra credit'
work, though, for anyone who's looking for something to help out with:
there is no Official Requirement that we complete all this testing, so
no-one needs to get stressed out or pull any all-nighters :)

If no-one has any objections I'll plan to put up the first set of
matrices this week sometime. Again, this is completely optional 'just
something we can be working on' stuff, so if you're not interested, skip
on by :)

If anyone has any ideas to improve/refine this effort, do reply!
-- 
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net
http://www.happyassassin.net

[Jóhann B. Guðmundsson]

On 04/01/2014 04:27 PM, Adam Williamson wrote:
>  If anyone has any ideas to improve/refine this effort, do reply!
Has this been cordinated with devs so found issues from this process 
will be looked at ( they themselves might just ignore reported bugs if 
they are working themselves on other changes )?

JBG

[Adam Williamson]

On Tue, 2014-04-01 at 16:35 +0000, "Jóhann B. Guðmundsson" wrote:
>  On 04/01/2014 04:27 PM, Adam Williamson wrote:
>  > If anyone has any ideas to improve/refine this effort, do reply!
>  
>  Has this been cordinated with devs so found issues from this process 
>  will be looked at ( they themselves might just ignore reported bugs if 
>  they are working themselves on other changes )? 
Good question, I ran it by bcl this morning and he was positive:

<adamw> bcl: hey, quick feedback request if you don't mind - we (QA) are
thinking of running monthly validation tests on rawhide until we hit
alpha, just to catch anything that's really bent out of shape. would you
be OK with that? would you like us to filter the reports somehow so as
not to flood bugzilla, or OK just to report what we find as usual?
 this would be the normal installation validation testing
<bcl> sounds like a good idea to me.
 We've got the composes running, may as well use them for something.

We did talk about limiting the reporting somehow - it would be best to
report only fairly significant issues, it's probably not necessary to
report smaller polish issues yet. I'll include a note about that with
the 'announcement'.
-- 
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net
http://www.happyassassin.net

[Mukundan Ragavan]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1



On 04/01/2014 11:27 AM, Adam Williamson wrote:
>  Hi folks!
>   
>  
>  If no-one has any objections I'll plan to put up the first set of 
>  matrices this week sometime. Again, this is completely optional
>  'just something we can be working on' stuff, so if you're not
>  interested, skip on by :)
>  
>  If anyone has any ideas to improve/refine this effort, do reply!
>   
This is an excellent idea - at least to keep track of how things are
going if not for anything else! :)


> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v2.0.22 (GNU/Linux)
>
> iQIcBAEBAgAGBQJTPC82AAoJEGqtW2dEe0yGBkAP/05j//uDHri2hDf+K4Ifua+4
> 7QXLiuJXkFUpcRIxPfcomW9Vz6EX0AdMqQQovMTUvhGFQZIhtIHu141H2CT8fjoQ
> Ibf8//AgG6DcNNE/Aq1YPIDykN/MPt8XX6eDI9jSGZLVwvGWmP4fhLnkmyurYMMA
> n5iGPRlHBlELIbfeHUv8aNuCbjryf3qRFLqSfJgZYWbWC0CI6b0A05gnYFlq4Stw
> r/8z0N7be+ox0opA9XutwSQQrVwvT/jmXsIbXcsj0b89KJXO+Dgv/CVRuFsq0eD9
> XoSYVBdux3iT2SzvLP08hdBLCYFy4AW4gbCZitLz6NufC8eGb8psQCxp5wr+dCUo
> 76Qs2KyuabzpC1b6DqpsUKBqjiAjTzX9HFJY4CRj3Wz9xbm0gQ5vwBZCDiBROne3
> /rHaO3dsa7vyzJKU1kxiU5WUwSwVWkwtGYr0kuxZnl8Kjk+SSedMQKh7GYzm5r0c
> psXydDAUwBToQQjnJHjFuE4Wtgj74bsaKL3kWj8Itlz6MxlhlwwHFpNlaqx0rbhg
> kMyKELDKlDMu0mi3Qrv5CljxjAmsogWaaNBCyU6DMOcuD+duJT4WM/wbkq3Mp5Bl
> oagG6hlHHtZWjPgDo4j4wxperl9iApxqatfGnqV/Bf7CU2F4shynJQjvCB067a5M
> InYSIVNrP1ijY2qHy5J1
> =h9tK
> -----END PGP SIGNATURE-----