[Test-Announce] 2011-02 Graphics Test Week recap

Thu Mar 3 08:14:31 UTC 2011

I'm curious about the accounting method. I see there are some Nouveau
bugs listed CLOSED DUPLICATE. I raised one as a result of the test
day, 679404, it was later marked duplicate of 679924 (which is in the
list).

Just wondering what it means when some bugs are listed and some aren't.

-Cam

On Thu, Mar 3, 2011 at 3:22 AM, Adam Williamson <awilliam at redhat.com> wrote:
> Another Graphics Test Week has gone by, so here's the statistical recap!
>
> Participation was back up again to one of its highest levels ever this
> time, which is great: thanks to everyone who came out and also promoted
> the event. We got some really solid testing in and already resolved some
> major issues for the F15 Alpha.
>
> Here's an updated version of the numbers I've been running:
>
> f11 nouveau: 104 tests, 42 bugs - ratio 0.40
> f12 nouveau: 53 tests, 34 bugs - ratio 0.64
> f13 nouveau: 78 tests, 26 bugs - ratio 0.33
> f14 nouveau: 39 tests, 8 bugs - ratio 0.21
> f15 nouveau: 83 tests, 55 bugs - ratio 0.66
>
> f11 radeon: 55 tests, 46 bugs - ratio 0.84
> f12 radeon: 61 tests, 81 bugs - ratio 1.33
> f13 radeon: 48 tests, 33 bugs - ratio 0.69
> f14 radeon: 32 tests, 18 bugs - ratio 0.56
> f15 radeon: 66 tests, 38 bugs - ratio 0.58
>
> f11 intel: 23 tests, 21 bugs - ratio 0.91
> f12 intel: 29 tests, 31 bugs - ratio 1.07
> f13 intel: 38 tests, 38 bugs - ratio 1.00
> f14 intel: 33 tests, 28 bugs - ratio 0.84
> f15 intel: 37 tests, 25 bugs - ratio 0.68
>
> Intel and Radeon both posted solid bugs-to-tests ratios. Nouveau is up
> significantly; I theorize that the cause of this is the increased level
> of functionality needed to support Shell, which mostly falls in areas
> that are difficult for the nouveau driver (being based on reverse
> engineering, rather than provided specs, as with the other two drivers).
>
> Here's the other chart, tracking how we handle the bugs
> that are reported - obviously, this time adding the numbers for F14 as
> we can't see into the future for the F15 bugs...
>
> f11 nouveau: 42 bugs, 4 open, 8 closeddupe, 24 closedfixed, 6 closedunfixed - 70.59%
> f12 nouveau: 34 bugs, 11 open, 8 closeddupe, 14 closedfixed, 1 closedunfixed - 53.85%
> f13 nouveau: 27 bugs, 17 open, 6 closeddupe, 3 closedfixed, 1 closedunfixed - 14.29%
> f14 nouveau: 8 bugs, 5 open, 3 closeddupe - 0% (small sample)
>
> f11 radeon: 46 bugs, 14 open, 10 closeddupe, 19 closedfixed, 3 closedunfixed - 52.78%
> f12 radeon: 81 bugs, 19 open, 32 closeddupe, 28 closedfixed, 2 closedunfixed - 57.14%
> f13 radeon: 36 bugs, 28 open, 3 closeddupe, 5 closedfixed, 0 closedunfixed - 15.15%
> f14 radeon: 18 bugs, 13 open, 0 closeddupe, 3 closedfixed, 2 closedunfixed - 16.67%
>
> f11 intel: 21 bugs, 7 open, 1 closeddupe, 12 closedfixed, 1 closedunfixed - 60%
> f12 intel: 31 bugs, 7 open, 12 closeddupe, 12 closedfixed, 0 closedunfixed - 63.16%
> f13 intel: 42 bugs, 26 open, 4 closeddupe, 11 closedfixed, 1 closedunfixed - 28.95%
> f14 intel: 28 bugs, 21 open, 4 closeddupe, 1 closedfixed, 2 closedunfixed - 4.17%
>
> To refresh your memories, the percentage is 'closedfixed' / (bugs -
> 'closeddupe') * 100, the intention being to give an indication of what
> proportion of bug reports wind up in a fix. Full details in the F13
> recap -
> http://lists.fedoraproject.org/pipermail/test/2010-April/090271.html .
>
> This continues a worrying trend from last time; we really seem to be
> dropping our rate of fixing Test Day bugs. I will try to investigate in
> more detail to see what's happening here.
>
> The raw lists of bugs reported from the F15 Test Days follow. Thanks
> very much to all testers, and to the wonderful Fedora X.org developers
> and triagers:
>
> Adam Jackson
> Dave Airlie
> Jerome Glisse
> Ben Skeggs
> Matej Cepl
>
> Nouveau
> -------
>
> 679429 NEW  - [NV86] Segfault logging out after startx
> 677461 NEW  - [abrt] gnome-settings-daemon-2.91.9-4.fc15: __libc_start_main: Process /usr/libexec/gnome-settings-daemon was killed by signal 11 (SIGSEGV)
> 677555 NEW  - [abrt] gnome-user-share-2.30.2-4.fc15: check_mixed_deps: Process /usr/libexec/gnome-user-share was killed by signal 6 (SIGABRT)
> 679494 NEW  - [abrt] totem-1:2.91.6-4.fc15: find_root: Process /usr/bin/totem was killed by signal 11 (SIGSEGV)
> 677810 NEW  - Fedora Rawhide LiveCD - crashes on startup @ mutter
> 679319 NEW  - F15: NVA3/NVA5/NVA8/NVAF (GT2xx) issues (random hang, no 3d, no Xv)
> 679326 NEW  - Shell only works on second try (likely due to too-short timeout on gnome-session-is-accelerated)
> 679330 NEW  - [NV86] artifacts after loging into gnome
> 679331 NEW  - after switching to terminal and back, window decorations are missing
> 679366 NEW  - [NV1f] nForce2 IGP - flickering and unusable desktop
> 679509 NEW  - multihead with DVI and TV connected crashes after user switch
> 679552 NEW  - [NVa8] Nouveau Test Day: random drawing errors on GT200 [GeForce 210] [10de:0a65]
> 679559 NEW  - nouveau display locks up - /usr/bin/Xorg (xorg_backtrace+0x2f) [0x4a120f]
> 679564 NEW  - GeForce 6600 GT doesn't log into Gnome Shell, falls back to old gnome desktop
> 679576 NEW  - X hangs shortly after startup
> 679595 NEW  - [NV86] Xserver crashes on window resize
> 679601 NEW  - [NVIDIA ION] GNOME 3 Shell fails to start
> 679619 NEW  - F15 Nouveau test day image freeze when try to start X. Total screen corruption. nvidia Geforce Go 6150
> 679625 NEW  - X.org nouveau driver freeze complete system when drawing complex 3D graphics...
> 679626 NEW  - Stray textmode characters when restarting X.org using Nouveau X.org driver...
> 679629 NEW  - Fast userswitch and glxgears in comibination with Nouveau X.org driver causes glxgears to crash...
> 679640 NEW  - F15 nouveau test day: fast user switch had issues
> 679656 NEW  - Nouveau Test Day: Text rendering becomes garbled
> 679956 NEW  - No login screen for nouveau test day livecd
> 679957 NEW  - Boots to blank screen with multi monitor  for nouveau test day livecd
> 680677 NEW  - Xorg crashes with nouveau driver when switching vt FAST
> 680745 NEW  - fast user switching does not work
> 680746 NEW  - vt switching does not work
> 679624 NEW  - When connecting one additional monitor, two new monitors appear in the configuration tool
> 677104 NEW  - [abrt] glx-utils-7.10-4.20101028.fc15: ureg_src: Process /usr/bin/glxgears was killed by signal 11 (SIGSEGV)
> 679432 NEW  - Graphics test day live image won't boot
> 679558 NEW  - System freezes unless there is mouse or keyboard activity
> 679631 NEW  - failure to recover from suspend on lenovo thinkstation D20
> 679614 NEW  - Gnome-shell loading can be broken by switching into console
> 680065 NEW  - Potential security problem with fast user switch
> 679809 NEW  - [abrt] mutter-2.91.6-4.fc15: ureg_src: Process /usr/bin/mutter was killed by signal 11 (SIGSEGV)
> 679111 NEW  - [abrt] xorg-x11-server-Xorg-1.9.99.1-4.20101201.fc15: OsAbort: Process /usr/bin/Xorg was killed by signal 6 (SIGABRT)
> 680656 NEW  - [abrt] xorg-x11-server-Xorg-1.9.99.1-4.20101201.fc15: Process /usr/bin/Xorg was killed by signal 11 (SIGSEGV)
> 582420 NEW  - fast user switching: black screen
> 573096 NEW  - NV1f Chipset - Garbled Display. Needs nouveau.tv_disable=1 on boot to work
> 630765 NEW  - System boot hangs often with nouveau error: Pointer to BIT loadval table invalid
> 642728 NEW  - nouveau: DisplayPort -> DVI external monitor modeset/probe fails on nvaf
> 582699 NEW  - xset dpms force off doesn't stick.
> 503267 ASSIGNED  - x server restarts on vt7, not vt1
> 517917 ASSIGNED  - NV1f chipset. Screen moved one line down.
> 679505 ON_QA  - Rotation fails.
> 677371 CLOSED NOTABUG - [abrt] mutter-2.91.6-3.fc15: ureg_src_undef: Process /usr/bin/mutter was killed by signal 11 (SIGSEGV)
> 678193 CLOSED DUPLICATE - Crash on Logging In to GNOME Shell
> 671294 CLOSED NOTABUG - geforce 6600 / nouveau - mutter crashes
> 679528 CLOSED DUPLICATE - Test Day:2011-02-22 Nouveau:restartx test fails
> 679657 CLOSED DUPLICATE - Screen rotation doesn't work on GeForce 6600
> 677842 CLOSED DUPLICATE - [abrt] mutter-2.91.6-4.fc15: ureg_src: Process /usr/bin/mutter was killed by signal 11 (SIGSEGV) - gcc buggy when building 32-bit with -fno-omit-frame-pointer
> 679622 CLOSED UPSTREAM - When selecting Suspend, the system shuts down
> 677567 CLOSED DUPLICATE - [abrt] mutter-2.91.6-4.fc15: ureg_src_undef: Process /usr/bin/mutter was killed by signal 11 (SIGSEGV)
> 679488 CLOSED DUPLICATE - Starts in fallback Gnome, after ctrl-alt-BS (or such) Gnome shell starts
>
> Radeon
> ------
>
> 677461 NEW  - [abrt] gnome-settings-daemon-2.91.9-4.fc15: __libc_start_main: Process /usr/libexec/gnome-settings-daemon was killed by signal 11 (SIGSEGV)
> 677555 NEW  - [abrt] gnome-user-share-2.30.2-4.fc15: check_mixed_deps: Process /usr/libexec/gnome-user-share was killed by signal 6 (SIGABRT)
> 679326 NEW  - Shell only works on second try (likely due to too-short timeout on gnome-session-is-accelerated)
> 679826 NEW  - default control center window can't be resized on 1024x768 monitor
> 679674 NEW  - ATI RV280 [Radeon 9200 PRO] Fails Testcase_radeon_basic (logs are from VESA driver)
> 679774 NEW  - Process /usr/bin/glxgears was killed by signal 11
> 680494 NEW  - [abrt] mesa-demos-7.10-4.20101028.fc15: LinkShaders: Process /usr/lib64/mesa/brick was killed by signal 6 (SIGABRT)
> 680495 NEW  - [abrt] mesa-demos-7.10-4.20101028.fc15: LinkShaders: Process /usr/lib64/mesa/bump was killed by signal 6 (SIGABRT)
> 680496 NEW  - [abrt] mesa-demos-7.10-4.20101028.fc15: LinkShaders: Process /usr/lib64/mesa/mandelbrot was killed by signal 6 (SIGABRT)
> 680498 NEW  - [abrt] mesa-demos-7.10-4.20101028.fc15: CreateProgram: Process /usr/lib64/mesa/multitex was killed by signal 6 (SIGABRT)
> 680499 NEW  - [abrt] mesa-demos-7.10-4.20101028.fc15: LinkShaders: Process /usr/lib64/mesa/skinning was killed by signal 6 (SIGABRT)
> 680500 NEW  - [abrt] mesa-demos-7.10-4.20101028.fc15: LinkShaders: Process /usr/lib64/mesa/texdemo1 was killed by signal 6 (SIGABRT)
> 680501 NEW  - [abrt] mesa-demos-7.10-4.20101028.fc15: LinkShaders: Process /usr/lib64/mesa/toyball was killed by signal 6 (SIGABRT)
> 679963 NEW  - System fails to resume after suspend
> 680118 NEW  - [Radeon test day] Screen goes dark, locks up hard
> 679849 NEW  - keyboard and mouse lock up in gnome-shell for fedora 15 radeon test day
> 680146 NEW  - [Radeon test day] Bubbles/menu placement broken with multi-head
> 680453 NEW  - Login to gnome-shell hangs on Radeon Mobility X1600
> 679579 NEW  - GNOME Shell graphics corruption on R200
> 679588 NEW  - R200 misrenders some mesa demos
> 679806 NEW  - Test Day, Ati, Gnome Shell doesn't start
> 679841 NEW  - xf86CloseConsole: VT_WAITACTIVE failed: Interrupted system call
> 679867 NEW  - Can't switch back to original rotation
> 679868 NEW  - F15 graphics test day: xset dpms force off has no effect in VM
> 679912 NEW  - gnome-shell does not start on Radeon Mobility X1600
> 680123 NEW  - [Radeon test day] When rotating the built-in LVDS display in a multi-head configuration, it gets garbled
> 680131 NEW  - [Radeon test day] Desktop only recognizes second head (dis)connection when xrandr is run
> 680445 NEW  - GNOME Shell lock-up with mouse cursor frozen
> 680511 NEW  - Crash when trying to run compiz-gtk --replace (ATI Radeon Mobility X1600)
> 653803 NEW  - [RV280] regression in F15 gnome-display-properties reports single Monitor:Unknown 0Hz instead of recognizing two monitors
> 532201 ASSIGNED  - KMS:RV770LE:HD4830 Suspending fails on Fedora 13
> 677371 CLOSED NOTABUG - [abrt] mutter-2.91.6-3.fc15: ureg_src_undef: Process /usr/bin/mutter was killed by signal 11 (SIGSEGV)
> 678193 CLOSED DUPLICATE - Crash on Logging In to GNOME Shell
> 677842 CLOSED DUPLICATE - [abrt] mutter-2.91.6-4.fc15: ureg_src: Process /usr/bin/mutter was killed by signal 11 (SIGSEGV) - gcc buggy when building 32-bit with -fno-omit-frame-pointer
> 677931 CLOSED WORKSFORME - [RS480] Fedora Rawhide LiveCD - crashes on startup @ mutter : in r300_dri.so
> 679685 CLOSED DUPLICATE - Gnome Shell doesn't start in Testday LiveCD
> 679903 CLOSED WORKSFORME - glxgears crash with ATI driver
> 679981 CLOSED DUPLICATE - Gnome Shell toolbar text garbled on RV250
>
> Intel
> -----
>
> 679776 NEW  - [Cantiga] Xv video leads to freeze of video and later whole system
> 679990 NEW  - [Cantiga] screen brightness is reduced when change rotation from "180 degrees" to "Normal"
> 680066 NEW  - [Cantiga] Turning off LCD display also turns off external display
> 680082 NEW  - Running etracer disables external display
> 680116 NEW  - [Cantiga] Quitting OpenGL app crashes Xorg
> 680132 NEW  - QA:Testcase_intelvideo_restartx fails on Acer Aspire netbook
> 680142 NEW  - QA:Testcase_intelvideo_suspend fails on Acer Aspire netbook
> 680325 NEW  - initial screen spans closed laptop display and external monitor
> 680333 NEW  - can't switch to external only mode on laptop
> 680565 NEW  - X server restart when rotating screen
> 680569 NEW  - [Crestline] multihead setup: trying to turn off LVDS results in both displays are blank ... confusing LVDS and DVI
> 680571 NEW  - intelvideo VT test fails: X Server restart when trying to return to X Session
> 675040 NEW  - [abrt] totem-1:2.91.6-2.fc15: Process /usr/bin/totem was killed by signal 6 (SIGABRT)
> 677555 NEW  - [abrt] gnome-user-share-2.30.2-4.fc15: check_mixed_deps: Process /usr/libexec/gnome-user-share was killed by signal 6 (SIGABRT)
> 680231 NEW  - cannot launch totem lookup error
> 679326 NEW  - Shell only works on second try (likely due to too-short timeout on gnome-session-is-accelerated)
> 680098 NEW  - Pressing "Return" in gdm after entering password makes login fail
> 680065 NEW  - Potential security problem with fast user switch
> 680104 NEW  - Suspend fails
> 680037 NEW  - [Calistoga] Xorg is killed when second monitor is connected
> 582532 NEW  - DPMS - display wakes up after 15 seconds
> 639057 NEW  - display switching fails with desktop effects enabled
> 639229 NEW  - Closing latop lid changes dualhead configuration wildly
> 639243 NEW  - Plugging out and into docking station again doesn't restore previous dualhead mode
> 680272 NEW  - x11 seg fault when logging out
> 680570 CLOSED DUPLICATE - multihead setup: xrandr (cli) fails to turn off monitor
> 679622 CLOSED UPSTREAM - When selecting Suspend, the system shuts down
> --
> Adam Williamson
> Fedora QA Community Monkey
> IRC: adamw | Fedora Talk: adamwill AT fedoraproject DOT org
> http://www.happyassassin.net
>
> _______________________________________________
> test-announce mailing list
> test-announce at lists.fedoraproject.org
> https://admin.fedoraproject.org/mailman/listinfo/test-announce
> --
> devel mailing list
> devel at lists.fedoraproject.org
> https://admin.fedoraproject.org/mailman/listinfo/devel
>