Automatic Smoketests for the Cloud Images: What to Test?

[Frankie]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

I would love to assist with this.
Kindly let me know how I can be of best use.

Kind Regards,


On 03/05/2014 02:58 PM, Sandro "red" Mathys wrote:
> Heads-up: I've taken ownership for the external need "Automatic 
> Smoketests on Image Build" [0]
> 
> Testing an image takes time and resources, and with several images,
> it takes several times that. Since that simply doesn't scale -
> well, doesn't even work well without scaling - we want to automate
> the smoketests using Taskotron. Unfortunately, Taskotron is still
> in a very early development phase and having mentioned only just
> our (most) basic needs, Tim estimates it won't be good enough for
> us in the target timeframe (i.e. by F21 Alpha). There's a slight
> chance it will be ready, but even then we still need time to
> implement the smoketests.
> 
> So if we want to have Taskotron ready for us in time, we need to
> find some developer(s) committing some of their resources. Any
> takers? If you're interested, head to [1] to learn more, there's
> also a contribution guide linked from there. I'm sure tflink in
> #fedora-qa is happy to talk to people still interested after
> reading through the wiki if there's further questions.
> 
> Also, we need to compile our actual needs. What kind of tests do
> we want to run? Most basic tests (things that we manually tested in
> the past) are probably: - Was the IP correctly set up? - Is SSH
> running and reachable? - Does the fedora user exist? - Is the ssh
> pubkey installed for the fedora user? - Is the fedora user able to
> use sudo? - Is the root account locked? - Is package installation
> working? - Is the firewall disabled? - Checking cloud-init and
> systemctl for bootup errors - does that make sense or is there too
> much noise?
> 
> What else can / should we test? Obviously the tailored images
> should be tested for their specific stuff but lets first focus on
> the common ground.
> 
> Thanks, Sandro
> 
> [0]
> https://fedoraproject.org/wiki/Cloud_Changelist#External_Need:_Automatic_Smoketests_on_Image_Build
>
> 
[1] https://fedoraproject.org/wiki/Taskotron
> _______________________________________________ cloud mailing list 
> cloud at lists.fedoraproject.org 
> https://admin.fedoraproject.org/mailman/listinfo/cloud Fedora Code
> of Conduct: http://fedoraproject.org/code-of-conduct
> 
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQIcBAEBAgAGBQJTGMOJAAoJEJGS9+sdPu4ECvkP/Rdn+E9VN3ile16aIXbBvHq8
XF0AStwIvW96/0H8EwTnqxDvbDaxGmPHRyLyXR6e8giizdGb46NIX9xFb0+rIzSi
2/8wQ7mI4Q2DQQ5VPsU4OAU3upw1CZqoGGYZEB7RphTjX4kMqKY6uVQ83ZU660gl
ANvDb5tSebtpd31p9Sii1e5TCuRncWJzvwXvtvE98RJaLWZZk1Rp8Zg22Imdvma6
KqzEbswNYMQC0ap6hKBKltIr622QaXFWhXES8EOK5P5eYE0OKZApDi053GyHNoZS
9i6MheJEcEhOl1MJ4bdh14LccQdk0RdxvxA6LdArLT/wZJK7GMeuFS9FSbtf+qLc
c1hO9jQ2guApvB78Z+iteHEygRExeThCQtpp6FV52FvRjl3VqC7uJLYo+ozXbDTb
mX/8eVOAhoVZn/EFHN73kWPb/46NQyjzrY2qNCLtksAj05SMxp7N2insREL7CjNS
EPWKgmnFnrFaCYhLhPRpJDa9QnlIe6ZuBAM3FNSm6OSxtcc/sajGAY8aBtzVBwhW
pwa45iRloIJResZ214+5guhj0JvQHsft1izWvpbSdjREqJ83s2cDFZ++o346BZjw
OanE1LRhTBILZliByzROrAEWPuAeGnUDTrxlJmqYhRrCQrVpCQ2r1DsTH4seoQKO
q86qF6u52XfCtIDSlfD4
=lwvT
-----END PGP SIGNATURE-----