Flexible Metadata Format: Test Case Relevancy

[Petr Šplíchal]

Hi!

Following the first set of essential attributes for the Flexible
Metadata Format we are starting to discuss a new attribute which
could be used to specify environment for which a test case is
relevant. The first draft is available on the Metadata wiki:

https://fedoraproject.org/wiki/CI/Metadata#Relevancy

This new attribute should help us to better share test code
between Fedora and RHEL as it allows to store and maintain test
code at a single place and run for all appropriate environments.

Feedback is welcome.

psss...

[Stef Walter]

Do you have an full example of how this fits together with the Standard
Test Specification? ... both for beakerlib and non-beakerlib tests?

Stef

On 14.05.2018 16:47, Petr Šplíchal wrote:
> Hi!
>
> Following the first set of essential attributes for the Flexible
> Metadata Format we are starting to discuss a new attribute which
> could be used to specify environment for which a test case is
> relevant. The first draft is available on the Metadata wiki:
>
> https://fedoraproject.org/wiki/CI/Metadata#Relevancy
>
> This new attribute should help us to better share test code
> between Fedora and RHEL as it allows to store and maintain test
> code at a single place and run for all appropriate environments.
>
> Feedback is welcome.
>
> psss...
>
> CI mailing list -- [e-mail]
> To unsubscribe send an email to [e-mail]

[Petr Šplíchal]

I've put together an example of how Flexible Metadata Format
could be integrated with Standard Test Roles on the SELinux tests:

https://fedoraproject.org/wiki/CI/Metadata/Examples

It illustrates how FMF can prevent manually maintaining long lists
of tests to be executed. Test Case Relevancy would be applied as
part of the standard test roles. In this case it is a beakerlib role
but similar/same approach could be applied in other roles as well.

Does that make it a bit more clear?

psss...

On 15 May 2018 at 11:27, Stef Walter  wrote:
> Do you have an full example of how this fits together with the Standard
> Test Specification? ... both for beakerlib and non-beakerlib tests?
>
> Stef
>
> On 14.05.2018 16:47, Petr Šplíchal wrote:
> > Hi!
> >
> > Following the first set of essential attributes for the Flexible
> > Metadata Format we are starting to discuss a new attribute which
> > could be used to specify environment for which a test case is
> > relevant. The first draft is available on the Metadata wiki:
> > https://fedoraproject.org/wiki/CI/Metadata#Relevancy
> >
> > This new attribute should help us to better share test code
> > between Fedora and RHEL as it allows to store and maintain test
> > code at a single place and run for all appropriate environments.
> >
> > Feedback is welcome.
> >
> > psss...