In the interest of transparency and communication, I am sharing the nightly RHQ test automation results from QE with the RHQ community in the report below.
Just so you know...
From: noreply@redhat.com
To: jon-qa-list@redhat.com
Sent: Wednesday, July 17, 2013 9:00:03 AM
Subject: [jon-qa-list] Summary report for 'RHQ Overnight Full Report'
Report Engine - Email ReportHello, This is auto generated email from Report Engine. It's based on
RHQ Overnight Full Report | Test Suite Name | Total | Passed | Failed | Skipped | Build | Start Time | End Time | Duration |
| Import Resources | 4 (0) | 0 (0) | 4 (0) | 0 (0) | - | Jul 16 04:19:28 IST 2013 | Jul 16 04:29:38 IST 2013 | 00:10:10 |
| RHQ REST JAVA Client Test | 40 (0) | 20 (0) | 20 (0) | 0 (0) | 4.9.0-SNAPSHOT (6867162) | Jul 10 11:55:13 IST 2013 | Jul 10 11:55:30 IST 2013 | 00:00:16 |
| RHQ REST Groovy Client Test | 8 (0) | 8 (0) | 0 (0) | 0 (0) | 4.9.0-SNAPSHOT (6867162) | Jul 10 11:54:33 IST 2013 | Jul 10 11:54:40 IST 2013 | 00:00:06 |
| RHQ 4.x core UI Test | 276 (+2) | 216 (-51) | 59 (+53) | 1 (0) | 4.9.0-SNAPSHOT (6867162) | Jul 10 10:29:02 IST 2013 | Jul 10 11:53:34 IST 2013 | 01:24:31 |
| RHQ CLI JS/JAVA Test | 92 (0) | 54 (+1) | 1 (-1) | 37 (0) | 4.9.0-SNAPSHOT (59fa894) | Jun 30 22:12:46 IST 2013 | Jun 30 22:56:26 IST 2013 | 00:43:39 |
| RHQ_4.4_UI_AS7Plugin_Test | 2 (-170) | 1 (-2) | 0 (0) | 0 (-169) | - | Feb 11 11:50:14 IST 2013 | - | - |
| RHQ CLI EAP6 | 28 (-14) | 0 (-3) | 0 (-28) | 28 (+17) | rhq.build.version | Feb 11 11:46:16 IST 2013 | Feb 11 11:49:48 IST 2013 | 00:03:32 |
| Fresh Installation of RHQ | 1 (0) | 0 (0) | 1 (0) | 0 (0) | - | Dec 24 23:45:58 IST 2012 | Dec 24 23:47:26 IST 2012 | 00:01:28 |
| Check Resource Configuration | 1124 (-37) | 1122 (-36) | 1 (-1) | 0 (0) | - | Aug 23 16:30:28 IST 2012 | - | - |
| Summary: | 1575 | 1421 | 86 | 66 | | | | 02:23:44 |
Test Suite Detaild View:
Test Suite:
Import Resources | Group Name | Total | Passed | Failed | Skipped |
| GuiLoginTest | 1 | 0 | 1 | 0 |
| Version Information | 1 | 0 | 1 | 0 |
| GImportResourcesTest | 1 | 0 | 1 | 0 |
| GuiLogoutTest | 1 | 0 | 1 | 0 |
| Total: | 4 | 0 | 4 | 0 |
Test Suite:
RHQ REST JAVA Client Test | Group Name | Total | Passed | Failed | Skipped |
| Login Test Negative | 2 | 2 | 0 | 0 |
| check New Rest Api | 1 | 1 | 0 | 0 |
| Login Test Positive | 1 | 1 | 0 | 0 |
| List Status | 1 | 1 | 0 | 0 |
| Visit Platforms | 1 | 0 | 1 | 0 |
| Visit Platforms By Id | 1 | 0 | 1 | 0 |
| get Resource By Platform Name | 1 | 0 | 1 | 0 |
| get Resource By Platform Name And Category | 1 | 0 | 1 | 0 |
| get Resource By Category | 1 | 0 | 1 | 0 |
| get Resource By Paging | 1 | 0 | 1 | 0 |
| get Platform Xml | 1 | 1 | 0 | 0 |
| Validate Children | 1 | 0 | 1 | 0 |
| get Alerts For Resources | 1 | 0 | 1 | 0 |
| get Schedules For Resources | 1 | 0 | 1 | 0 |
| get Availability For Resources | 1 | 0 | 1 | 0 |
| get Availability History For Resources | 1 | 0 | 1 | 0 |
| get Root URI | 1 | 1 | 0 | 0 |
| get Json PWrapper | 1 | 1 | 0 | 0 |
| verify AS Server Presence | 1 | 0 | 1 | 0 |
| Check Platform Operations | 1 | 0 | 1 | 0 |
| Validate Schedules | 1 | 0 | 1 | 0 |
| Validate Metric Data Default | 1 | 0 | 1 | 0 |
| Validate Metric Data | 1 | 0 | 1 | 0 |
| Visit Alerts | 1 | 1 | 0 | 0 |
| Redirect From Definition | 1 | 1 | 0 | 0 |
| Alert Definitions | 1 | 1 | 0 | 0 |
| Alert Count | 1 | 1 | 0 | 0 |
| AlertSender | 1 | 1 | 0 | 0 |
| AlertSender_DirectEmails | 1 | 1 | 0 | 0 |
| AlertSender_Mobicents | 1 | 1 | 0 | 0 |
| AlertSender_NotExisting | 1 | 1 | 0 | 0 |
| get Event Sources | 1 | 0 | 1 | 0 |
| get Event Definitions | 1 | 0 | 1 | 0 |
| get Group | 1 | 1 | 0 | 0 |
| get Group With Params | 1 | 1 | 0 | 0 |
| get Metrics Schedule | 1 | 0 | 1 | 0 |
| get Metrics Schedule By Id | 1 | 0 | 1 | 0 |
| get Favorite Resources | 1 | 1 | 0 | 0 |
| get Favorite Groups | 1 | 1 | 0 | 0 |
| Total: | 40 | 20 | 20 | 0 |
Test Suite:
RHQ REST Groovy Client Test | Group Name | Total | Passed | Failed | Skipped |
| Status | 2 | 2 | 0 | 0 |
| Login | 3 | 3 | 0 | 0 |
| Resource | 3 | 3 | 0 | 0 |
| Total: | 8 | 8 | 0 | 0 |
Test Suite:
RHQ 4.x core UI Test | Group Name | Total | Passed | Failed | Skipped |
| GuiLoginTest | 1 | 1 | 0 | 0 |
| Version Information | 1 | 1 | 0 | 0 |
| Metric Collection Schedules validation | 39 | 39 | 0 | 0 |
| AlertDefinitionCreationTest | 13 | 0 | 13 | 0 |
| InventoryTest | 11 | 11 | 0 | 0 |
| BundleTest | 4 | 4 | 0 | 0 |
| TopLevelMenusTest | 12 | 12 | 0 | 0 |
| ReportsTest | 7 | 7 | 0 | 0 |
| DashboardTest | 12 | 12 | 0 | 0 |
| ResourcesTest | 5 | 5 | 0 | 0 |
| AdministrationTest | 6 | 6 | 0 | 0 |
| HelpTest | 10 | 10 | 0 | 0 |
| RecentOperationsTest | 5 | 3 | 1 | 1 |
| FavouriteTest | 4 | 4 | 0 | 0 |
| PluginsTest | 52 | 52 | 0 | 0 |
| Individualconfig | 4 | 4 | 0 | 0 |
| Configuration History | 2 | 2 | 0 | 0 |
| Group Config | 3 | 3 | 0 | 0 |
| SubNavigationMenuTests | 2 | 2 | 0 | 0 |
| Administration JSP page validation | 6 | 6 | 0 | 0 |
| Drift management-Create-[add/change/remove]-Delete | 5 | 5 | 0 | 0 |
| AlertHistoryValidationTest | 13 | 0 | 13 | 0 |
| AlertHistoryDeletionTest | 13 | 0 | 13 | 0 |
| AlertDefinitionDeletionTest | 13 | 0 | 13 | 0 |
| Scheduling Groups | 4 | 4 | 0 | 0 |
| Search groups... | 6 | 6 | 0 | 0 |
| Permissions Test | 7 | 6 | 1 | 0 |
| Alert Definition Template | 6 | 6 | 0 | 0 |
| CheckAlertDefTempCreated | 1 | 0 | 1 | 0 |
| Drift Definition Template | 3 | 3 | 0 | 0 |
| StorageAutoInventoryTest | 1 | 0 | 1 | 0 |
| StorageNode | 2 | 0 | 2 | 0 |
| Setup LDAP | 1 | 1 | 0 | 0 |
| GuiLDAPUserLoginTest | 1 | 0 | 1 | 0 |
| GuiLogoutTest | 1 | 1 | 0 | 0 |
| Total: | 276 | 216 | 59 | 1 |
Test Suite:
RHQ CLI JS/JAVA Test | Group Name | Total | Passed | Failed | Skipped |
| Import all Resources | 2 | 2 | 0 | 0 |
| Examples from jon documentation | 22 | 21 | 0 | 1 |
| bz reproduction test | 3 | 1 | 0 | 2 |
| Examples from rhq documentation | 4 | 3 | 0 | 1 |
| Samples from CLI client | 3 | 3 | 0 | 0 |
| operation scheduling test | 3 | 3 | 0 | 0 |
| manager test | 6 | 6 | 0 | 0 |
| permission test | 15 | 0 | 0 | 15 |
| role test | 2 | 1 | 0 | 1 |
| subject test | 2 | 2 | 0 | 0 |
| drift test | 1 | 1 | 0 | 0 |
| DynaGroup definitions test | 7 | 5 | 0 | 2 |
| Bundles | 15 | 5 | 0 | 10 |
| schedule_Management_For_RHQ_Agent | 1 | 1 | 0 | 0 |
| stress test | 5 | 0 | 0 | 5 |
| Uninventory-Platforms-End | 1 | 0 | 1 | 0 |
| Total: | 92 | 54 | 1 | 37 |
Test Suite:
RHQ_4.4_UI_AS7Plugin_Test | Group Name | Total | Passed | Failed | Skipped |
| GuiLoginTest | 1 | 1 | 0 | 0 |
| Version Information | 1 | 0 | 0 | 0 |
| Total: | 2 | 1 | 0 | 0 |
Test Suite:
RHQ CLI EAP6 | Group Name | Total | Passed | Failed | Skipped |
| Standalone_Discovery_StartCommand_Parameters | 1 | 0 | 0 | 1 |
| Domain_Discovery_StartCommand_Parameters | 4 | 0 | 0 | 4 |
| Uninventory_EAP_Servers | 1 | 0 | 0 | 1 |
| Inventory_EAP_Servers | 1 | 0 | 0 | 1 |
| Detect_ServerVersion | 1 | 0 | 0 | 1 |
| Standalone_Deployment | 5 | 0 | 0 | 5 |
| Standalone_BundleDeployment | 1 | 0 | 0 | 1 |
| Standalone_NetworkInterfaces | 1 | 0 | 0 | 1 |
| Domain_Deployment | 11 | 0 | 0 | 11 |
| Domain_Host_NetworkInterfaces | 1 | 0 | 0 | 1 |
| Uninventory_EAP_Servers_again | 1 | 0 | 0 | 1 |
| Total: | 28 | 0 | 0 | 28 |
Test Suite:
Fresh Installation of RHQ | Group Name | Total | Passed | Failed | Skipped |
| GuiInstallationTest | 1 | 0 | 1 | 0 |
| Total: | 1 | 0 | 1 | 0 |
Test Suite:
Check Resource Configuration | Group Name | Total | Passed | Failed | Skipped |
| GuiLoginTest | 1 | 1 | 0 | 0 |
| Version Information | 1 | 1 | 0 | 0 |
| CheckResourceConfiguration | 1122 | 1120 | 1 | 0 |
| Total: | 1124 | 1122 | 1 | 0 |
Report Engine URL:
https://mercury.lab.eng.pnq.redhat.com:8443/reReport Generated on: Jul 17 18:30:00 IST 2013
_______________________________________________
jon-qa-list mailing list
jon-qa-list@redhat.com
https://post-office.corp.redhat.com/mailman/listinfo/jon-qa-list