Merging Fedora IoT Release Criteria into Fedora QA Criteria

[Geoffrey Marr]

Hi everyone,

As Fedora IoT is an official edition now, the Fedora QA team finds it
necessary to merge the existing Fedora IoT release criteria [0] into the
existing criteria [1]. As it stands however, the IoT criteria have not been
"rated" as to which criteria go where; Basic, Beta, or Final.

The purpose of my email is to start a discussion on how to "rate" each
criterion listed [0]. Should there be different versions of each criterion
for Basic, Beta, and Final? Are some more important and as such, expected
to work from inception (Basic)? Which are these?

Fedora QA would like to have the official Fedora QA criteria page [1]
updated soon, (certainly before F33 launch), so that there is an
established quality standard to which IoT will reach.

Thanks for reading.

Geoff Marr
IRC: coremodule

[0] https://docs.fedoraproject.org/en-US/iot/release-criteria/
[1] https://fedoraproject.org/wiki/Fedora_Release_Criteria

[Klein Kravis]

Maybe we should look at the Silverblue criteria, it seems that IoT and Sliverblue share some similarities

On Sep 7 2020, at 10:32 pm, Geoffrey Marr  wrote:
> Hi everyone,
>
> As Fedora IoT is an official edition now, the Fedora QA team finds it necessary to merge the existing Fedora IoT release criteria [0] into the existing criteria [1]. As it stands however, the IoT criteria have not been "rated" as to which criteria go where; Basic, Beta, or Final.
>
> The purpose of my email is to start a discussion on how to "rate" each criterion listed [0]. Should there be different versions of each criterion for Basic, Beta, and Final? Are some more important and as such, expected to work from inception (Basic)? Which are these?
>
> Fedora QA would like to have the official Fedora QA criteria page [1] updated soon, (certainly before F33 launch), so that there is an established quality standard to which IoT will reach.
>
> Thanks for reading.
>
> Geoff Marr
> IRC: coremodule
>
> [0] https://docs.fedoraproject.org/en-US/iot/release-criteria/ (https://link.getmailspring.com/link/09090B2A-8877-421F-B551-07BDB08EEA33@get...)
> [1] https://fedoraproject.org/wiki/Fedora_Release_Criteria (https://link.getmailspring.com/link/09090B2A-8877-421F-B551-07BDB08EEA33@get...)
>
> test mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/[e-mail]

[Paul Whalen]

Hi Geoff,

----- Original Message -----
> Hi everyone,
>
> As Fedora IoT is an official edition now, the Fedora QA team finds it
> necessary to merge the existing Fedora IoT release criteria [0] into the
> existing criteria [1]. As it stands however, the IoT criteria have not been
> "rated" as to which criteria go where; Basic, Beta, or Final.
>
> The purpose of my email is to start a discussion on how to "rate" each
> criterion listed [0]. Should there be different versions of each criterion
> for Basic, Beta, and Final? Are some more important and as such, expected to
> work from inception (Basic)? Which are these?

Looking at our test template[1], the tests currently have a Milestone rating.

The tests that are common between the Fedoras should share the same Milestone, 
currently some do not- they should likely be aligned for simplicity. The IoT
specific tests were given a Milestone that made sense to our group, but we're
also open to further discussion there if they need to be adjusted.

Thanks for getting this started,
Paul

[1] - https://fedoraproject.org/wiki/Template:General_IoT_test_matrix
> Fedora QA would like to have the official Fedora QA criteria page [1] updated
> soon, (certainly before F33 launch), so that there is an established quality
> standard to which IoT will reach.
>
> Thanks for reading.
>
> Geoff Marr
> IRC: coremodule
>
> [0] https://docs.fedoraproject.org/en-US/iot/release-criteria/
> [1] https://fedoraproject.org/wiki/Fedora_Release_Criteria
>
> IoT mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct:
> https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]

[Geoffrey Marr]

Hi all,

The following links are temporary locations of the modified Fedora QA
criteria adding IoT, based on the IoT test-matrix template [0].
Respectively, they are as follows: Basic, Basic diff, F33 Beta, F33 Beta
diff, F33 Final, F33 Final diff [0] [1] [2] [3] [4] [5].

If you have time, please review them so we can merge the changes into the
official Fedora QA criteria pages.

Geoff Marr
IRC: coremodule

[0] https://fedoraproject.org/wiki/Template:General_IoT_test_matrix
[1] https://fedoraproject.org/wiki/Coremodule/Basic_Release_Criteria
[2]
https://fedoraproject.org/w/index.php?title=Coremodule%2FBasic_Release_Crite...
[3]
https://fedoraproject.org/wiki/Coremodule/Fedora_33_Beta_Release_Criteria
[4]
https://fedoraproject.org/w/index.php?title=Coremodule%2FFedora_33_Beta_Rele...
[5]
https://fedoraproject.org/wiki/Coremodule/Fedora_33_Final_Release_Criteria
[6]
https://fedoraproject.org/w/index.php?title=Coremodule%2FFedora_33_Final_Rel...

On Tue, Sep 8, 2020 at 2:26 PM Paul Whalen  wrote:
> Hi Geoff,
>
> ----- Original Message -----
> > Hi everyone,
> >
> > As Fedora IoT is an official edition now, the Fedora QA team finds it
> > necessary to merge the existing Fedora IoT release criteria [0] into the
> > existing criteria [1]. As it stands however, the IoT criteria have not
>
> been
> > "rated" as to which criteria go where; Basic, Beta, or Final.
> >
> > The purpose of my email is to start a discussion on how to "rate" each
> > criterion listed [0]. Should there be different versions of each
>
> criterion
> > for Basic, Beta, and Final? Are some more important and as such,
>
> expected to
> > work from inception (Basic)? Which are these?
>
> Looking at our test template[1], the tests currently have a Milestone
> rating.
>
> The tests that are common between the Fedoras should share the same
> Milestone,
> currently some do not- they should likely be aligned for simplicity. The
> IoT
> specific tests were given a Milestone that made sense to our group, but
> we're
> also open to further discussion there if they need to be adjusted.
>
> Thanks for getting this started,
> Paul
>
> [1] - https://fedoraproject.org/wiki/Template:General_IoT_test_matrix
> > Fedora QA would like to have the official Fedora QA criteria page [1]
>
> updated
> > soon, (certainly before F33 launch), so that there is an established
>
> quality
> > standard to which IoT will reach.
> >
> > Thanks for reading.
> >
> > Geoff Marr
> > IRC: coremodule
> >
> > [0] https://docs.fedoraproject.org/en-US/iot/release-criteria/
> > [1] https://fedoraproject.org/wiki/Fedora_Release_Criteria
> >
> > IoT mailing list -- [e-mail]
> > To unsubscribe send an email to [e-mail]
> > Fedora Code of Conduct:
> > https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives:
>
> https://lists.fedoraproject.org/archives/list/[e-mail]
> >
>
> IoT mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]
> Fedora Code of Conduct:
> https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
> https://lists.fedoraproject.org/archives/list/[e-mail]