Here a short report from the Power Management Fedora Test day on 10/22/09 [1]. First of all many thanks to all the people who participated in it and who reported their findings. In order to make things easier for testers and to make sure we get a lot more stable and comparable results Marcela Maslanova, Jan Vcelak and Petr Lautrbach put together a rpm that consisted of all our test scripts, an easy call-script to easily run them and a "collect" script to pack together all results. Additionally the rpm itself has requirements against all the packages we needed for the tests, so a simple installation of the testday rpm provided a solid and easy method for every tester. This worked out really well and made test results very consistent. Unfortunately time ran out for including the automatic upload script from Mike McGrath and the ALPM test script, but that didn't seem to pose a big problem, roughly half of the testers provided results for ALPM as well.
We got 30 results overall with half of them including ALPM test results, too. Overall the results showed us what we wanted to know:
- The tools we're shipping are working as expected, no crashes or anything like that observed - Wakeups and system behavior in genereral in comparison to our Fedora 11 test day doesn't show any regressions - New features seem to be working as expected
Rudolf Kastel discovered one strange bug with one of the profiles which we couldn't reproduce yet, but we're still investigating with him.
All in all the whole test day was a real success. Especially the great idea of Marcela, Jan and Petr to make a rpm for the testday which automated a lot of the work that needed to be done.
For the next testday we already plan to expand that idea and include the automated upload script which will make it even easier for the testers.
[1] https://fedoraproject.org/wiki/Test_Day:2009-10-22
Phil Knirsch wrote:
All in all the whole test day was a real success. Especially the great idea of Marcela, Jan and Petr to make a rpm for the testday which automated a lot of the work that needed to be done.
For the next testday we already plan to expand that idea and include the automated upload script which will make it even easier for the testers.
I would have participated if I could have run Rawhide from my USB drive, but it seems test day images are no longer created and the USB drive I was trying to use kept overheating after attempting to update from Beta 2 to the latest rawhide (several hundred packages). It's my own fault for using a shoddy drive, but are test images no longer being made? Even though I do have a slew of machines, I'm not privileged enough to have a completely unused machine to install rawhide full time on. Next time I'll attempt using a external HDD USB drive, which should have more success.
On 10/29/2009 02:48 PM, Michael Cronenworth wrote:
Phil Knirsch wrote:
All in all the whole test day was a real success. Especially the great idea of Marcela, Jan and Petr to make a rpm for the testday which automated a lot of the work that needed to be done.
For the next testday we already plan to expand that idea and include the automated upload script which will make it even easier for the testers.
I would have participated if I could have run Rawhide from my USB drive, but it seems test day images are no longer created and the USB drive I was trying to use kept overheating after attempting to update from Beta 2 to the latest rawhide (several hundred packages). It's my own fault for using a shoddy drive, but are test images no longer being made? Even though I do have a slew of machines, I'm not privileged enough to have a completely unused machine to install rawhide full time on. Next time I'll attempt using a external HDD USB drive, which should have more success.
We were thinking about some image, but for measurement we needed installed system. Anyway requirements for tests were huge e.g. openoffice, kernel-debuginfo.
Marcela Mašláňová on 10/29/2045 08:17 AM wrote:
We were thinking about some image, but for measurement we needed installed system. Anyway requirements for tests were huge e.g. openoffice, kernel-debuginfo.
When you use a USB drive you can install any number of packages. Just set your test-day.rpm to Require: openoffice and people could do so.
On Thu, 2009-10-29 at 09:24 -0500, Michael Cronenworth wrote:
Marcela Mašláňová on 10/29/2045 08:17 AM wrote:
We were thinking about some image, but for measurement we needed installed system. Anyway requirements for tests were huge e.g. openoffice, kernel-debuginfo.
When you use a USB drive you can install any number of packages.
Not exactly, you need enough spare memory and/or swap space, because they get installed into 'memory'.
Just set your test-day.rpm to Require: openoffice and people could do so.
Most people couldn't as they'd run out of RAM.
The fact that the organizers specified an installed system was required is the reason I didn't bother spinning live images for this test day, it seemed pointless given that fact.
We do still spin test day live images when they are useful/required. For some events, though, we just link to the latest nightly live image, when there's no need for any customization for the test day.
On Thu, 2009-10-29 at 13:15 -0500, Michael Cronenworth wrote:
Adam Williamson on 10/29/2009 01:13 PM wrote:
Not exactly, you need enough spare memory and/or swap space, because they get installed into 'memory'.
Not when you use persistent storage... I have an updated F11 USB stick that would like to meet you. :)
Hmm, point. I kinda thought persistent storage was only for /home though? IMBW. If so, we'll reconsider for future test days.
Hey,
I just had the weirdest thing ever, on Fedora 12
I was working on my desktop, running F-12, KVM and like 10 VM's up and running. I had clicked on the "update" button, but since I was using a voip (hardware) phone had not yet clicked on "download updates". I iconified the window to get rid of it while on my call and forgot about it.
Later, while just doing some file editing, a (gnome power management?) popup appears with a power button on the left side, stating "Paul Wouters is logged on. System will shut down in 60 seconds". Looking at the popup kinda surprised, I move my hand to my mouse to hit cancel and before I reached my mouse, the machine does an instant poweroff, leaving me stunned in a very quiet room pondering about my 10 VM's that just crashed along with it.
After the boot, it seems I have no new updates left to install :P Also, kernel did not change, still 2.6.31.6-166.fc12.x86_64, so even if this was some automatic update effect timed badly, I am not sure why it needed to poweroff my machine.
I'm not sure which component to bug report for, or whose Christmas present to take away :P
Paul
On Thu, 2009-10-29 at 14:40 +0100, Phil Knirsch wrote:
Here a short report from the Power Management Fedora Test day on 10/22/09 [1]. First of all many thanks to all the people who participated in it and who reported their findings.
For the next testday we already plan to expand that idea and include the automated upload script which will make it even easier for the testers.
Thanks very much for running the Test Day and organizing it so expertly! It's great to have the process running smoothly enough that we can get events off the ground like this with almost no direct management being done by QA, and great to know the system is valuable for you.
-
Adam Williamson -
Marcela Mašláňová -
Michael Cronenworth -
Paul Wouters -
Phil Knirsch