[Test-Announce] 2011-02 Graphics Test Week recap

Thu Mar 3 03:22:49 UTC 2011

Another Graphics Test Week has gone by, so here's the statistical recap!

Participation was back up again to one of its highest levels ever this
time, which is great: thanks to everyone who came out and also promoted
the event. We got some really solid testing in and already resolved some
major issues for the F15 Alpha.

Here's an updated version of the numbers I've been running:

f11 nouveau: 104 tests, 42 bugs - ratio 0.40
f12 nouveau: 53 tests, 34 bugs - ratio 0.64
f13 nouveau: 78 tests, 26 bugs - ratio 0.33
f14 nouveau: 39 tests, 8 bugs - ratio 0.21
f15 nouveau: 83 tests, 55 bugs - ratio 0.66

f11 radeon: 55 tests, 46 bugs - ratio 0.84
f12 radeon: 61 tests, 81 bugs - ratio 1.33
f13 radeon: 48 tests, 33 bugs - ratio 0.69
f14 radeon: 32 tests, 18 bugs - ratio 0.56
f15 radeon: 66 tests, 38 bugs - ratio 0.58

f11 intel: 23 tests, 21 bugs - ratio 0.91
f12 intel: 29 tests, 31 bugs - ratio 1.07
f13 intel: 38 tests, 38 bugs - ratio 1.00
f14 intel: 33 tests, 28 bugs - ratio 0.84
f15 intel: 37 tests, 25 bugs - ratio 0.68

Intel and Radeon both posted solid bugs-to-tests ratios. Nouveau is up
significantly; I theorize that the cause of this is the increased level
of functionality needed to support Shell, which mostly falls in areas
that are difficult for the nouveau driver (being based on reverse
engineering, rather than provided specs, as with the other two drivers).

Here's the other chart, tracking how we handle the bugs
that are reported - obviously, this time adding the numbers for F14 as
we can't see into the future for the F15 bugs...

f11 nouveau: 42 bugs, 4 open, 8 closeddupe, 24 closedfixed, 6 closedunfixed - 70.59%
f12 nouveau: 34 bugs, 11 open, 8 closeddupe, 14 closedfixed, 1 closedunfixed - 53.85%
f13 nouveau: 27 bugs, 17 open, 6 closeddupe, 3 closedfixed, 1 closedunfixed - 14.29%
f14 nouveau: 8 bugs, 5 open, 3 closeddupe - 0% (small sample)

f11 radeon: 46 bugs, 14 open, 10 closeddupe, 19 closedfixed, 3 closedunfixed - 52.78%
f12 radeon: 81 bugs, 19 open, 32 closeddupe, 28 closedfixed, 2 closedunfixed - 57.14%
f13 radeon: 36 bugs, 28 open, 3 closeddupe, 5 closedfixed, 0 closedunfixed - 15.15%
f14 radeon: 18 bugs, 13 open, 0 closeddupe, 3 closedfixed, 2 closedunfixed - 16.67%

f11 intel: 21 bugs, 7 open, 1 closeddupe, 12 closedfixed, 1 closedunfixed - 60%
f12 intel: 31 bugs, 7 open, 12 closeddupe, 12 closedfixed, 0 closedunfixed - 63.16%
f13 intel: 42 bugs, 26 open, 4 closeddupe, 11 closedfixed, 1 closedunfixed - 28.95%
f14 intel: 28 bugs, 21 open, 4 closeddupe, 1 closedfixed, 2 closedunfixed - 4.17%

To refresh your memories, the percentage is 'closedfixed' / (bugs -
'closeddupe') * 100, the intention being to give an indication of what
proportion of bug reports wind up in a fix. Full details in the F13
recap -
http://lists.fedoraproject.org/pipermail/test/2010-April/090271.html .

This continues a worrying trend from last time; we really seem to be
dropping our rate of fixing Test Day bugs. I will try to investigate in
more detail to see what's happening here.

The raw lists of bugs reported from the F15 Test Days follow. Thanks
very much to all testers, and to the wonderful Fedora X.org developers
and triagers:

Adam Jackson
Dave Airlie
Jerome Glisse
Ben Skeggs
Matej Cepl

Nouveau
-------

679429 NEW  - [NV86] Segfault logging out after startx
677461 NEW  - [abrt] gnome-settings-daemon-2.91.9-4.fc15: __libc_start_main: Process /usr/libexec/gnome-settings-daemon was killed by signal 11 (SIGSEGV)
677555 NEW  - [abrt] gnome-user-share-2.30.2-4.fc15: check_mixed_deps: Process /usr/libexec/gnome-user-share was killed by signal 6 (SIGABRT)
679494 NEW  - [abrt] totem-1:2.91.6-4.fc15: find_root: Process /usr/bin/totem was killed by signal 11 (SIGSEGV)
677810 NEW  - Fedora Rawhide LiveCD - crashes on startup @ mutter
679319 NEW  - F15: NVA3/NVA5/NVA8/NVAF (GT2xx) issues (random hang, no 3d, no Xv)
679326 NEW  - Shell only works on second try (likely due to too-short timeout on gnome-session-is-accelerated)
679330 NEW  - [NV86] artifacts after loging into gnome
679331 NEW  - after switching to terminal and back, window decorations are missing
679366 NEW  - [NV1f] nForce2 IGP - flickering and unusable desktop
679509 NEW  - multihead with DVI and TV connected crashes after user switch
679552 NEW  - [NVa8] Nouveau Test Day: random drawing errors on GT200 [GeForce 210] [10de:0a65]
679559 NEW  - nouveau display locks up - /usr/bin/Xorg (xorg_backtrace+0x2f) [0x4a120f]
679564 NEW  - GeForce 6600 GT doesn't log into Gnome Shell, falls back to old gnome desktop
679576 NEW  - X hangs shortly after startup
679595 NEW  - [NV86] Xserver crashes on window resize
679601 NEW  - [NVIDIA ION] GNOME 3 Shell fails to start
679619 NEW  - F15 Nouveau test day image freeze when try to start X. Total screen corruption. nvidia Geforce Go 6150
679625 NEW  - X.org nouveau driver freeze complete system when drawing complex 3D graphics...
679626 NEW  - Stray textmode characters when restarting X.org using Nouveau X.org driver...
679629 NEW  - Fast userswitch and glxgears in comibination with Nouveau X.org driver causes glxgears to crash...
679640 NEW  - F15 nouveau test day: fast user switch had issues
679656 NEW  - Nouveau Test Day: Text rendering becomes garbled
679956 NEW  - No login screen for nouveau test day livecd
679957 NEW  - Boots to blank screen with multi monitor  for nouveau test day livecd
680677 NEW  - Xorg crashes with nouveau driver when switching vt FAST
680745 NEW  - fast user switching does not work
680746 NEW  - vt switching does not work
679624 NEW  - When connecting one additional monitor, two new monitors appear in the configuration tool
677104 NEW  - [abrt] glx-utils-7.10-4.20101028.fc15: ureg_src: Process /usr/bin/glxgears was killed by signal 11 (SIGSEGV)
679432 NEW  - Graphics test day live image won't boot
679558 NEW  - System freezes unless there is mouse or keyboard activity
679631 NEW  - failure to recover from suspend on lenovo thinkstation D20
679614 NEW  - Gnome-shell loading can be broken by switching into console
680065 NEW  - Potential security problem with fast user switch
679809 NEW  - [abrt] mutter-2.91.6-4.fc15: ureg_src: Process /usr/bin/mutter was killed by signal 11 (SIGSEGV)
679111 NEW  - [abrt] xorg-x11-server-Xorg-1.9.99.1-4.20101201.fc15: OsAbort: Process /usr/bin/Xorg was killed by signal 6 (SIGABRT)
680656 NEW  - [abrt] xorg-x11-server-Xorg-1.9.99.1-4.20101201.fc15: Process /usr/bin/Xorg was killed by signal 11 (SIGSEGV)
582420 NEW  - fast user switching: black screen
573096 NEW  - NV1f Chipset - Garbled Display. Needs nouveau.tv_disable=1 on boot to work
630765 NEW  - System boot hangs often with nouveau error: Pointer to BIT loadval table invalid
642728 NEW  - nouveau: DisplayPort -> DVI external monitor modeset/probe fails on nvaf
582699 NEW  - xset dpms force off doesn't stick.
503267 ASSIGNED  - x server restarts on vt7, not vt1
517917 ASSIGNED  - NV1f chipset. Screen moved one line down.
679505 ON_QA  - Rotation fails.
677371 CLOSED NOTABUG - [abrt] mutter-2.91.6-3.fc15: ureg_src_undef: Process /usr/bin/mutter was killed by signal 11 (SIGSEGV)
678193 CLOSED DUPLICATE - Crash on Logging In to GNOME Shell
671294 CLOSED NOTABUG - geforce 6600 / nouveau - mutter crashes
679528 CLOSED DUPLICATE - Test Day:2011-02-22 Nouveau:restartx test fails
679657 CLOSED DUPLICATE - Screen rotation doesn't work on GeForce 6600
677842 CLOSED DUPLICATE - [abrt] mutter-2.91.6-4.fc15: ureg_src: Process /usr/bin/mutter was killed by signal 11 (SIGSEGV) - gcc buggy when building 32-bit with -fno-omit-frame-pointer
679622 CLOSED UPSTREAM - When selecting Suspend, the system shuts down
677567 CLOSED DUPLICATE - [abrt] mutter-2.91.6-4.fc15: ureg_src_undef: Process /usr/bin/mutter was killed by signal 11 (SIGSEGV)
679488 CLOSED DUPLICATE - Starts in fallback Gnome, after ctrl-alt-BS (or such) Gnome shell starts

Radeon
------

677461 NEW  - [abrt] gnome-settings-daemon-2.91.9-4.fc15: __libc_start_main: Process /usr/libexec/gnome-settings-daemon was killed by signal 11 (SIGSEGV)
677555 NEW  - [abrt] gnome-user-share-2.30.2-4.fc15: check_mixed_deps: Process /usr/libexec/gnome-user-share was killed by signal 6 (SIGABRT)
679326 NEW  - Shell only works on second try (likely due to too-short timeout on gnome-session-is-accelerated)
679826 NEW  - default control center window can't be resized on 1024x768 monitor
679674 NEW  - ATI RV280 [Radeon 9200 PRO] Fails Testcase_radeon_basic (logs are from VESA driver)
679774 NEW  - Process /usr/bin/glxgears was killed by signal 11
680494 NEW  - [abrt] mesa-demos-7.10-4.20101028.fc15: LinkShaders: Process /usr/lib64/mesa/brick was killed by signal 6 (SIGABRT)
680495 NEW  - [abrt] mesa-demos-7.10-4.20101028.fc15: LinkShaders: Process /usr/lib64/mesa/bump was killed by signal 6 (SIGABRT)
680496 NEW  - [abrt] mesa-demos-7.10-4.20101028.fc15: LinkShaders: Process /usr/lib64/mesa/mandelbrot was killed by signal 6 (SIGABRT)
680498 NEW  - [abrt] mesa-demos-7.10-4.20101028.fc15: CreateProgram: Process /usr/lib64/mesa/multitex was killed by signal 6 (SIGABRT)
680499 NEW  - [abrt] mesa-demos-7.10-4.20101028.fc15: LinkShaders: Process /usr/lib64/mesa/skinning was killed by signal 6 (SIGABRT)
680500 NEW  - [abrt] mesa-demos-7.10-4.20101028.fc15: LinkShaders: Process /usr/lib64/mesa/texdemo1 was killed by signal 6 (SIGABRT)
680501 NEW  - [abrt] mesa-demos-7.10-4.20101028.fc15: LinkShaders: Process /usr/lib64/mesa/toyball was killed by signal 6 (SIGABRT)
679963 NEW  - System fails to resume after suspend
680118 NEW  - [Radeon test day] Screen goes dark, locks up hard
679849 NEW  - keyboard and mouse lock up in gnome-shell for fedora 15 radeon test day
680146 NEW  - [Radeon test day] Bubbles/menu placement broken with multi-head
680453 NEW  - Login to gnome-shell hangs on Radeon Mobility X1600
679579 NEW  - GNOME Shell graphics corruption on R200
679588 NEW  - R200 misrenders some mesa demos
679806 NEW  - Test Day, Ati, Gnome Shell doesn't start
679841 NEW  - xf86CloseConsole: VT_WAITACTIVE failed: Interrupted system call
679867 NEW  - Can't switch back to original rotation
679868 NEW  - F15 graphics test day: xset dpms force off has no effect in VM
679912 NEW  - gnome-shell does not start on Radeon Mobility X1600
680123 NEW  - [Radeon test day] When rotating the built-in LVDS display in a multi-head configuration, it gets garbled
680131 NEW  - [Radeon test day] Desktop only recognizes second head (dis)connection when xrandr is run
680445 NEW  - GNOME Shell lock-up with mouse cursor frozen
680511 NEW  - Crash when trying to run compiz-gtk --replace (ATI Radeon Mobility X1600)
653803 NEW  - [RV280] regression in F15 gnome-display-properties reports single Monitor:Unknown 0Hz instead of recognizing two monitors
532201 ASSIGNED  - KMS:RV770LE:HD4830 Suspending fails on Fedora 13
677371 CLOSED NOTABUG - [abrt] mutter-2.91.6-3.fc15: ureg_src_undef: Process /usr/bin/mutter was killed by signal 11 (SIGSEGV)
678193 CLOSED DUPLICATE - Crash on Logging In to GNOME Shell
677842 CLOSED DUPLICATE - [abrt] mutter-2.91.6-4.fc15: ureg_src: Process /usr/bin/mutter was killed by signal 11 (SIGSEGV) - gcc buggy when building 32-bit with -fno-omit-frame-pointer
677931 CLOSED WORKSFORME - [RS480] Fedora Rawhide LiveCD - crashes on startup @ mutter : in r300_dri.so
679685 CLOSED DUPLICATE - Gnome Shell doesn't start in Testday LiveCD
679903 CLOSED WORKSFORME - glxgears crash with ATI driver
679981 CLOSED DUPLICATE - Gnome Shell toolbar text garbled on RV250

Intel
-----

679776 NEW  - [Cantiga] Xv video leads to freeze of video and later whole system
679990 NEW  - [Cantiga] screen brightness is reduced when change rotation from "180 degrees" to "Normal"
680066 NEW  - [Cantiga] Turning off LCD display also turns off external display
680082 NEW  - Running etracer disables external display
680116 NEW  - [Cantiga] Quitting OpenGL app crashes Xorg
680132 NEW  - QA:Testcase_intelvideo_restartx fails on Acer Aspire netbook
680142 NEW  - QA:Testcase_intelvideo_suspend fails on Acer Aspire netbook
680325 NEW  - initial screen spans closed laptop display and external monitor
680333 NEW  - can't switch to external only mode on laptop
680565 NEW  - X server restart when rotating screen
680569 NEW  - [Crestline] multihead setup: trying to turn off LVDS results in both displays are blank ... confusing LVDS and DVI
680571 NEW  - intelvideo VT test fails: X Server restart when trying to return to X Session
675040 NEW  - [abrt] totem-1:2.91.6-2.fc15: Process /usr/bin/totem was killed by signal 6 (SIGABRT)
677555 NEW  - [abrt] gnome-user-share-2.30.2-4.fc15: check_mixed_deps: Process /usr/libexec/gnome-user-share was killed by signal 6 (SIGABRT)
680231 NEW  - cannot launch totem lookup error
679326 NEW  - Shell only works on second try (likely due to too-short timeout on gnome-session-is-accelerated)
680098 NEW  - Pressing "Return" in gdm after entering password makes login fail
680065 NEW  - Potential security problem with fast user switch
680104 NEW  - Suspend fails
680037 NEW  - [Calistoga] Xorg is killed when second monitor is connected
582532 NEW  - DPMS - display wakes up after 15 seconds
639057 NEW  - display switching fails with desktop effects enabled
639229 NEW  - Closing latop lid changes dualhead configuration wildly
639243 NEW  - Plugging out and into docking station again doesn't restore previous dualhead mode
680272 NEW  - x11 seg fault when logging out
680570 CLOSED DUPLICATE - multihead setup: xrandr (cli) fails to turn off monitor
679622 CLOSED UPSTREAM - When selecting Suspend, the system shuts down
-- 
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Fedora Talk: adamwill AT fedoraproject DOT org
http://www.happyassassin.net

_______________________________________________
test-announce mailing list
test-announce at lists.fedoraproject.org
https://admin.fedoraproject.org/mailman/listinfo/test-announce