Fedora Core testing

[Mohammed Omar]

Hi all,

I do Fedora Core testing as a part of Community Distro test at IBM .
Basic idea is to find bugs at early stages of Distro release on  X and P
series hardware. Initially I started fedora testing on Power box and
later will test on Xseries.I would like to share the releases of FC8
tested,Hardware used, test suites executed and no. of bugs found.

Covered Releases:
----------------

Releases: Date: status:
FC8test1 07 Aug 2007 finished
FC8test2 13 Sept 2007 finished
FC8test3 04 Oct 2007 finished
FC8GA 08 Nov 2007      currently testing

Test suites used for testing above releases 
--------------------------------------------

Installation/Upgradation testing
NFS/HTTP/FTP/local installations.
Smoke testing includes LTP
Stress testing
Core kernel and regression testing 
Memory stress
FS stress testing etc,.


Hardware Used for fedora core testing:
---------------------------------------
PPC64 : P520, P55 , JS21 , P630b 
i386:  X445       [ Used for network tests ]
X86_64:  X3400    [ Used for network tests ]


Total no. of Bugs Found: 11 ,  closed: 3
----------------------------------------
Listing some of the bugs here...

https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=239658
https://bugzilla.redhat.com/show_bug.cgi?id=268241
https://bugzilla.redhat.com/show_bug.cgi?id=353021

Most of the bugs closed internally. Basically I do concentrate on system
testing to find more bugs in kernel.

New Features tested: 
--------------------
EXT4 fs tested with fs stress, NFS ,SAMBA.
I am also looking to test Kdump on Fedora.

I would like to invite Fedora users and testers to join in testing
fedora effectively.

--Thanks
Omar M,

[Josh Boyer]

On Tue, 20 Nov 2007 19:14:44 +0530
Mohammed Omar <omar(a)linux.vnet.ibm.com&gt; wrote:

>  Hi all,
>  
>  I do Fedora Core testing as a part of Community Distro test at IBM .
>  Basic idea is to find bugs at early stages of Distro release on  X and P
>  series hardware. Initially I started fedora testing on Power box and
>  later will test on Xseries.I would like to share the releases of FC8
>  tested,Hardware used, test suites executed and no. of bugs found. 
Great.  More QA is always welcome!

>  Listing some of the bugs here...
>  
>  https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=239658 
That is actually an F7 bug... does it still happen in F8?

>  New Features tested: 
>  --------------------
>  EXT4 fs tested with fs stress, NFS ,SAMBA. 
EXT4 isn't included in the Fedora kernels for F8.  Testing it is of
course good in the long run, but it's not testing the Fedora kernel at
that point.

(By the way, there is no more "Core" in the name.  It's just Fedora
now.)

josh

[Dennis Gilmore]

On Tuesday 20 November 2007, Mohammed Omar wrote:
>  Hi all,
>
>  I do Fedora Core testing as a part of Community Distro test at IBM .
>  Basic idea is to find bugs at early stages of Distro release on  X and P
>  series hardware. Initially I started fedora testing on Power box and
>  later will test on Xseries.I would like to share the releases of FC8
>  tested,Hardware used, test suites executed and no. of bugs found. 
For one  there is
no longer a "Fedora Core"  there is just "Fedora"   its just 
F8 

>  Covered Releases:
>  ----------------
>
>  Releases: Date: status:
>  FC8test1 07 Aug 2007 finished
>  FC8test2 13 Sept 2007 finished
>  FC8test3 04 Oct 2007 finished
>  FC8GA 08 Nov 2007      currently testing
>
>  Test suites used for testing above releases
>  --------------------------------------------
>
>  Installation/Upgradation testing
>  NFS/HTTP/FTP/local installations.
>  Smoke testing includes LTP
>  Stress testing
>  Core kernel and regression testing
>  Memory stress
>  FS stress testing etc,. 
sounds very intresting 

>  Hardware Used for fedora core testing:
>  ---------------------------------------
>  PPC64 : P520, P55 , JS21 , P630b
>  i386:  X445       [ Used for network tests ]
>  X86_64:  X3400    [ Used for network tests ]
>
>
>  Total no. of Bugs Found: 11 ,  closed: 3
>  ----------------------------------------
>  Listing some of the bugs here...
>
>  https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=239658
>  https://bugzilla.redhat.com/show_bug.cgi?id=268241
>  https://bugzilla.redhat.com/show_bug.cgi?id=353021 
perhaps you could have a tracker bug to keep track of all the bugs you find  
so they can all be easily referenced

>  Most of the bugs closed internally. Basically I do concentrate on
> system
>  testing to find more bugs in kernel.
>
>  New Features tested:
>  --------------------
>  EXT4 fs tested with fs stress, NFS ,SAMBA.
>  I am also looking to test Kdump on Fedora. 
Cool :)

>  I would like to invite Fedora users and testers to join in testing
>  fedora effectively. 
how do you propose to achieve this goal?
do you have a test matrix you follow?   do you have resources that you could 
give people access to help with testing?  

It sounds like a great goal.  you should probably work with Will Woods to help 
with his QA efforts.  you should also speak with David Woodhouse about ppc 
specific QA testing.

Dennis

[Mohammed Omar]

On Tue, 2007-11-20 at 08:47 -0600, Dennis Gilmore wrote: 
>  On Tuesday 20 November 2007, Mohammed Omar wrote:
>  > Hi all,
>  >
>  > I do Fedora Core testing as a part of Community Distro test at IBM .
>  > Basic idea is to find bugs at early stages of Distro release on  X and P
>  > series hardware. Initially I started fedora testing on Power box and
>  > later will test on Xseries.I would like to share the releases of FC8
>  > tested,Hardware used, test suites executed and no. of bugs found.
>  For one  there is no longer a "Fedora Core"  there is just "Fedora"  
> its just 
>  F8  
Thanks for your info. 
>  
>  > Covered Releases:
>  > ----------------
>  >
>  > Releases: Date: status:
>  > FC8test1 07 Aug 2007 finished
>  > FC8test2 13 Sept 2007 finished
>  > FC8test3 04 Oct 2007 finished
>  > FC8GA 08 Nov 2007      currently testing
>  >
>  > Test suites used for testing above releases
>  > --------------------------------------------
>  >
>  > Installation/Upgradation testing
>  > NFS/HTTP/FTP/local installations.
>  > Smoke testing includes LTP
>  > Stress testing
>  > Core kernel and regression testing
>  > Memory stress
>  > FS stress testing etc,.
>  sounds very intresting 
>  
>  >
>  > Hardware Used for fedora core testing:
>  > ---------------------------------------
>  > PPC64 : P520, P55 , JS21 , P630b
>  > i386:  X445       [ Used for network tests ]
>  > X86_64:  X3400    [ Used for network tests ]
>  >
>  >
>  > Total no. of Bugs Found: 11 ,  closed: 3
>  > ----------------------------------------
>  > Listing some of the bugs here...
>  >
>  > https://bugzilla.redhat.com/bugzilla/show_bug.cgi?id=239658
>  > https://bugzilla.redhat.com/show_bug.cgi?id=268241
>  > https://bugzilla.redhat.com/show_bug.cgi?id=353021
>  
>  perhaps you could have a tracker bug to keep track of all the bugs you find  
>  so they can all be easily referenced 
Ofcourse, generally i raise bugs in IBM bugzilla and that will be
mirrored out to the community(Redhat bugzilla). I have given some of the
links which mirrored to Redhat bugzilla as IBM bugzilla cannot be
accessed outside.

>  > Most of the bugs closed internally. Basically I do concentrate
> on system
>  > testing to find more bugs in kernel.
>  >
>  > New Features tested:
>  > --------------------
>  > EXT4 fs tested with fs stress, NFS ,SAMBA.
>  > I am also looking to test Kdump on Fedora.
>  
>  Cool :)
>  
>  > I would like to invite Fedora users and testers to join in testing
>  > fedora effectively.
>  
>  how do you propose to achieve this goal?
>  do you have a test matrix you follow?   do you have resources that you could 
>  give people access to help with testing? 
We have our own test plan for Fedora
Testing. 
  
>  
>  It sounds like a great goal.  you should probably work with Will Woods to help 
>  with his QA efforts.  you should also speak with David Woodhouse about ppc 
>  specific QA testing. 
Thanks for your quick reply and valuable suggestions .
Definitely, I am looking into this. 

--thanks
omar

[David Woodhouse]

On Wed, 2007-11-21 at 19:14 +0530, Mohammed Omar wrote:
>  Ofcourse, generally i raise bugs in IBM bugzilla and that will be
>  mirrored out to the community(Redhat bugzilla). 
Although I know you are encouraged to do it that way for RHEL bugs, for
Fedora it is the opposite -- please try to file bugs in Fedora bugzilla
directly.

Also, it would be very useful if we could get you to help us with
testing in _advance_ of the releases. Especially on PowerPC as we
approach Fedora 9, we would like more people to be testing rawhide as we
prepare to make the Alpha/Beta/etc. releases. 

-- 
dwmw2

[Thorsten Leemhuis]

On 20.11.2007 14:44, Mohammed Omar wrote:
>  [...]
>  Test suites used for testing above releases 
>  --------------------------------------------
>  
>  Installation/Upgradation testing
>  NFS/HTTP/FTP/local installations.
>  Smoke testing includes LTP
>  Stress testing
>  Core kernel and regression testing 
>  Memory stress
>  FS stress testing etc,.
>  [...] 
I some weeks ago created a package kcbench for Fedora, which compiles a
kernel to measure the build time or test system stability. Maybe it can
be useful for your work. If you need any additional features kcbench
just let me know or send patches ;-)

Cu
knurd