EC2 AMI Test Case Review Request

[Tim Flink]

Now that EC2 functionality is a release requirement, I've written up a
draft test case for EC2 AMIs. I tried to keep it straight forward
without writing a "how to use EC2" guide.

https://fedoraproject.org/wiki/User:Tflink/QA:Testcase_EC2_AMI_Validation...

I'd appreciate any suggestions or comments before moving it from a
draft page and adding it to the release validation matrices.

Tim

[Anton Arapov]

On Mon, Jan 09, 2012 at 08:10:42AM -0700, Tim Flink wrote:
>  Now that EC2 functionality is a release requirement, I've written
> up a
>  draft test case for EC2 AMIs. I tried to keep it straight forward
>  without writing a "how to use EC2" guide.
>  
>  https://fedoraproject.org/wiki/User:Tflink/QA:Testcase_EC2_AMI_Validation...
>  
>  I'd appreciate any suggestions or comments before moving it from a
>  draft page and adding it to the release validation matrices. 
Looks ok for me.

Anton.

[Justin Forbes]

On Mon, Jan 09, 2012 at 08:10:42AM -0700, Tim Flink wrote:
>  Now that EC2 functionality is a release requirement, I've written
> up a
>  draft test case for EC2 AMIs. I tried to keep it straight forward
>  without writing a "how to use EC2" guide.
>  
>  https://fedoraproject.org/wiki/User:Tflink/QA:Testcase_EC2_AMI_Validation...
>  
>  I'd appreciate any suggestions or comments before moving it from a
>  draft page and adding it to the release validation matrices.
>  
>  Tim 
I would say it is good, and fairly straight forward.  The only change I
might suggest is adding "The instance is capable of installing from the
default yum repository" to expected results.  We are shipping very bare
bones instances here.  There are really 4 key requirements:

1. The system will boot
2. You can ssh into the host as ec2-user with sudo access
3. You can install packages from the yum repository
4. The system is stable in all of these tasks.

Justin

[Tim Flink]

On Mon, 9 Jan 2012 11:48:12 -0600
"Justin M. Forbes" <jmforbes(a)linuxtx.org&gt; wrote:

>  I would say it is good, and fairly straight forward.  The only
> change
>  I might suggest is adding "The instance is capable of installing from
>  the default yum repository" to expected results.  We are shipping
>  very bare bones instances here.  There are really 4 key requirements:
>  
>  1. The system will boot
>  2. You can ssh into the host as ec2-user with sudo access
>  3. You can install packages from the yum repository
>  4. The system is stable in all of these tasks. 
Thanks for the feedback, I added expected results for SSH and
installation using yum.

Tim

[Max Spevack]

To what extent is it possible to run automated tests over Fedora AMIs? 
Is that being done at all?  What would it take to do it?

--Max

[Tim Flink]

On Tue, 10 Jan 2012 17:14:52 -0800 (PST)
Max Spevack <mspevack(a)fedoraproject.org&gt; wrote:

>  To what extent is it possible to run automated tests over Fedora
>  AMIs? Is that being done at all?  What would it take to do it? 
As far as I know, there are no automated tests being done on Fedora
AMIs. I don't think that it would take much to get some basic smoke
tests set up - someone to pay the bill, someone to write the test(s)
and someone to run those test(s) and look over the output.

Tim