Fedora 23 Branched 20151009 compose check report

[Kalev Lember]

On 10/09/2015 06:17 PM, Fedora compose checker wrote:
> No missing expected images.
> 
> Images in this compose but not 23 Branched 20151008:
> 
> Cloud docker x86_64
> 
> Images in 23 Branched 20151008 but not this:
> 
> Workstation disk raw armhfp
> 
> Failed openQA tests: 48 of 52
> 
> ID: 5182	Test: i386 kde_live default_install
> ID: 5181	Test: x86_64 workstation_live default_install at uefi
> ID: 5180	Test: x86_64 workstation_live default_install
> ID: 5179	Test: i386 workstation_live default_install
> ID: 5178	Test: x86_64 kde_live default_install
> ID: 5177	Test: i386 generic_boot default_install
> ID: 5176	Test: x86_64 generic_boot default_install at uefi
> ID: 5175	Test: x86_64 generic_boot default_install
> ID: 5174	Test: i386 universal upgrade_desktop_32bit
> ID: 5173	Test: i386 universal server_lvmthin
> ID: 5172	Test: i386 universal server_ext3
> ID: 5171	Test: i386 universal server_btrfs
> ID: 5170	Test: i386 universal server_software_raid
> ID: 5169	Test: i386 universal server_simple_encrypted
> ID: 5168	Test: i386 universal server_repository_http_graphical
> ID: 5167	Test: i386 universal server_scsi_updates_img
> ID: 5166	Test: i386 universal package_set_minimal
> ID: 5165	Test: x86_64 universal server_no_swap at uefi
> ID: 5164	Test: x86_64 universal server_lvmthin at uefi
> ID: 5163	Test: x86_64 universal server_ext3 at uefi
> ID: 5162	Test: x86_64 universal server_btrfs at uefi
> ID: 5161	Test: x86_64 universal server_software_raid at uefi
> ID: 5160	Test: x86_64 universal server_multi_empty at uefi
> ID: 5159	Test: x86_64 universal server_simple_free_space at uefi
> ID: 5158	Test: x86_64 universal server_simple_encrypted at uefi
> ID: 5157	Test: x86_64 universal server_delete_partial at uefi
> ID: 5156	Test: x86_64 universal server_delete_pata at uefi
> ID: 5155	Test: x86_64 universal server_sata_multi at uefi
> ID: 5154	Test: x86_64 universal european_language_install
> ID: 5153	Test: x86_64 universal server_shrink_ntfs
> ID: 5152	Test: x86_64 universal server_shrink_ext4
> ID: 5151	Test: x86_64 universal server_updates_img_local
> ID: 5147	Test: x86_64 universal server_no_swap
> ID: 5146	Test: x86_64 universal server_lvmthin
> ID: 5145	Test: x86_64 universal server_ext3
> ID: 5144	Test: x86_64 universal server_btrfs
> ID: 5143	Test: x86_64 universal server_software_raid
> ID: 5142	Test: x86_64 universal server_multi_empty
> ID: 5141	Test: x86_64 universal server_simple_free_space
> ID: 5140	Test: x86_64 universal server_simple_encrypted
> ID: 5139	Test: x86_64 universal server_delete_partial
> ID: 5138	Test: x86_64 universal server_repository_http_variation
> ID: 5137	Test: x86_64 universal server_repository_http_graphical
> ID: 5136	Test: x86_64 universal server_mirrorlist_graphical
> ID: 5135	Test: x86_64 universal server_delete_pata
> ID: 5133	Test: x86_64 universal server_scsi_updates_img
> ID: 5132	Test: x86_64 universal server_sata_multi
> ID: 5131	Test: x86_64 universal package_set_minimal

These failed test IDs are all nice to see, but they don't say much to
the uninitiated. :) These tests are comparing screenshots pixel by
pixel, right? Are the screenshots and other test results publicly
available somewhere?

How are the screenshots rebased? Is it all manual work?

Is there any way to link to the failed screenshots from the status mail
so that I could just follow links and see what's changed?

Sorry for bombing you with all the questions. I think it's totally
awesome that we have nightly testing, thanks for getting this set up!

Thanks,
Kalev