[UPDATE] Fedora 15 Security Lab Spin testing

[Adam Williamson]

On Fri, 2011-05-27 at 16:54 +0000, Athmane Madjoudj wrote:

> > Do you think you could write these up as test cases, following the
> > example of the existing test cases, and then categorize them as
> > package-related test cases using
> > https://fedoraproject.org/wiki/User:Adamwill/Draft_QA_SOP_package_test_plan_creation ? that would be really awesome. let me know if you need any help with it.
> 
> Yes, that exactly what I was thinking, though there's some issues:
> 
> 1. The tester must have some sort of Lab so he/she can do pen-testing 
> without having legal trouble (brute-force, port-scan, sniffing. auditing 
> apps, etc can be illegal without permission ...).

That's fine: it's always good to write up test procedures even if they
require advanced knowledge or tools to actually complete. The benefits
don't go away - it's still good to have the procedure documented so we
know it will be performed consistently, and categorized so we know what
test cases relate to what apps. Of course, you should note the
appropriate requirements to perform the test case in the description
and/or setup steps :)

> 2. I've noticed that ABRT is not included in Security Lab spin, which 
> make life harder to report bugs, especially for non-experienced.

That's interesting, maybe it could be added for future releases? For now
you could probably put this in the setup steps too. I'm fond of using
wiki templates in test cases: it's neat and easy. You can just create a
template page with the contents:

# Install the abrt tool to aid in bug reporting: {{command|su -c 'yum
install abrt'}}

and then include that template in the setup section of each test case.
Take a look at the gnome-color-manager test cases for an example of
this:

https://fedoraproject.org/wiki/Category:Package_gnome-color-manager_test_cases

if you look at the source you can see they all use a template for their
setup steps.

The actual instructions in this case would need to be a bit smarter, I
think, as you need to install several packages to have a working abrt
config; I think there may be a package group you can install or
something.
-- 
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Fedora Talk: adamwill AT fedoraproject DOT org
http://www.happyassassin.net