Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
COSMOS i9 QA Phase Execution
Revision as of 01:42, 26 February 2008 by Unnamed Poltroon (Talk)
This page created per the request from QA to track all i9 test execution activities from 25 Feb'08 to 07 Mar'08. This page will be filled in by the QA team as i9 testing phase proceeds.
Contents
- 1 QA Test Execution Activities for i9
- 2 E2E testing status (Windows XP SP2)
- 3 E2E testing status (Red Hat Enterprise Linux Server 5.0)
- 4 E2E testing status (Windows 2003 SP1)
- 5 i9 ERs - JUnits/Manual Tests Inspection
- 6 i9 End2End Regression Tests
- 7 Basic Operational effeciency tests
- 8 i9 Test Execution Results
QA Test Execution Activities for i9
Primary Tasks:
- E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0 (http://wiki.eclipse.org/COSMOS_DEMO_i9 )
- i9 ERs (16 ERs) – JUnits/Manual Tests inspection (Bugzilla: i9 Enhancements)
Secondary Tasks:
- Execution of regression test cases for all End2End scenarios.
- Basic operational efficiency tests (limited performance tests)
E2E testing status (Windows XP SP2)
Build Id: COSMOS-1.0.0-200802221728
| Test Description | Test Status | Remarks |
|---|---|---|
| Build Installation and Configuration
<cosmos-demo>/bin/configDemo.bat |
Passed | None |
| Starting COSMOS components
<tomcat-install-dir>/bin/startup.bat |
Passed | All 5 Data Managers started successfully |
| Get Brokers registered at Management Domain
COSMOS> domain getBrokers |
Passed | None |
| Get Data Managers register at the Broker
COSMOS> broker getDataManagers |
||
| CMDBf Query Execution
COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testInstanceIdQuery.txt |
||
| COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testPropertyQuery.txt | ||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-students.txt | ||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-teachers.txt | ||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\relationship-all-
classes.txt |
||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\teaches-relationship.txt | ||
| RegistrationExample ??? | ||
| Data Manager Services : Collecting Log Events from Logging Data Manager
logging getDatasets |
||
| logging getAllCBE access_log.cbe.xml | ||
| logging getCBECountBySeverity access_log.cbe.xml | ||
| logging getAllCBE windows_app_log.cbe.xml | ||
| logging getCBECountBySeverity access_log.cbe.xml | ||
| Data Manager Services : Collect webserver performance data from Statistical Data Manger | ||
| stat getDatasourceKeyset | ||
| stat getStatDataForSource "server 33 tomcat1181829221515" CBE | ||
| stat getStatDataForSource "server 33 tomcat1181829221515" TomcatSet | ||
| COSMOS Web User Interface tests (should be verified on both IE and Firefox)
Open http://localhost:8080/COSMOSUI/?page=cosmos (shd display 5 Data Managers nodes) |
||
| Expand Statistical and CBE Nodes | ||
| Verify the properties of all 5 nodes under Properties pane | ||
| Run all available CMDBf queries on SMLMDR and verify CMDBf response viewer | ||
| Run all available CMDBf queries on EXAMPLEMDR and verify CMDBf response viewer | ||
| Run all available CMDBf queries on RegisterationExample and verify CMDBf response viewer | ||
| Inspect all nodes under CMDBf Response viewer | ||
| Generate Top 10 Log reports for CBE of access_log.cbe.xml and windows_app_log.cbe.xml | ||
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" CBE | ||
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" TomcatSet |
E2E testing status (Red Hat Enterprise Linux Server 5.0)
Build Id: COSMOS-1.0.0-200802221728
| Test Description | Test Status | Remarks |
|---|---|---|
| Build Installation and Configuration
<cosmos-demo>/bin/configDemo.bat |
||
| Starting COSMOS components
<tomcat-install-dir>/bin/startup.bat |
||
| Get Brokers registered at Management Domain
COSMOS> domain getBrokers |
||
| Get Data Managers register at the Broker
COSMOS> broker getDataManagers |
||
| CMDBf Query Execution
COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testInstanceIdQuery.txt |
||
| COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testPropertyQuery.txt | ||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-students.txt | ||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-teachers.txt | ||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\relationship-all-
classes.txt |
||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\teaches-relationship.txt | ||
| RegistrationExample ??? | ||
| Data Manager Services : Collecting Log Events from Logging Data Manager
logging getDatasets |
||
| logging getAllCBE access_log.cbe.xml | ||
| logging getCBECountBySeverity access_log.cbe.xml | ||
| logging getAllCBE windows_app_log.cbe.xml | ||
| logging getCBECountBySeverity access_log.cbe.xml | ||
| Data Manager Services : Collect webserver performance data from Statistical Data Manger | ||
| stat getDatasourceKeyset | ||
| stat getStatDataForSource "server 33 tomcat1181829221515" CBE | ||
| stat getStatDataForSource "server 33 tomcat1181829221515" TomcatSet | ||
| COSMOS Web User Interface tests (should be verified on both IE and Firefox)
Open http://localhost:8080/COSMOSUI/?page=cosmos (shd display 5 Data Managers nodes) |
||
| Expand Statistical and CBE Nodes | ||
| Verify the properties of all 5 nodes under Properties pane | ||
| Run all available CMDBf queries on SMLMDR and verify CMDBf response viewer | ||
| Run all available CMDBf queries on EXAMPLEMDR and verify CMDBf response viewer | ||
| Run all available CMDBf queries on RegisterationExample and verify CMDBf response viewer | ||
| Inspect all nodes under CMDBf Response viewer | ||
| Generate Top 10 Log reports for CBE of access_log.cbe.xml and windows_app_log.cbe.xml | ||
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" CBE | ||
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" TomcatSet |
E2E testing status (Windows 2003 SP1)
Build Id: COSMOS-1.0.0-200802221728
| Test Description | Test Status | Remarks |
|---|---|---|
| Build Installation and Configuration
<cosmos-demo>/bin/configDemo.bat |
||
| Starting COSMOS components
<tomcat-install-dir>/bin/startup.bat |
||
| Get Brokers registered at Management Domain
COSMOS> domain getBrokers |
||
| Get Data Managers register at the Broker
COSMOS> broker getDataManagers |
||
| CMDBf Query Execution
COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testInstanceIdQuery.txt |
||
| COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testPropertyQuery.txt | ||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-students.txt | ||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-teachers.txt | ||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\relationship-all-
classes.txt |
||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\teaches-relationship.txt | ||
| RegistrationExample ??? | ||
| Data Manager Services : Collecting Log Events from Logging Data Manager
logging getDatasets |
||
| logging getAllCBE access_log.cbe.xml | ||
| logging getCBECountBySeverity access_log.cbe.xml | ||
| logging getAllCBE windows_app_log.cbe.xml | ||
| logging getCBECountBySeverity access_log.cbe.xml | ||
| Data Manager Services : Collect webserver performance data from Statistical Data Manger | ||
| stat getDatasourceKeyset | ||
| stat getStatDataForSource "server 33 tomcat1181829221515" CBE | ||
| stat getStatDataForSource "server 33 tomcat1181829221515" TomcatSet | ||
| COSMOS Web User Interface tests (should be verified on both IE and Firefox)
Open http://localhost:8080/COSMOSUI/?page=cosmos (shd display 5 Data Managers nodes) |
||
| Expand Statistical and CBE Nodes | ||
| Verify the properties of all 5 nodes under Properties pane | ||
| Run all available CMDBf queries on SMLMDR and verify CMDBf response viewer | ||
| Run all available CMDBf queries on EXAMPLEMDR and verify CMDBf response viewer | ||
| Run all available CMDBf queries on RegisterationExample and verify CMDBf response viewer | ||
| Inspect all nodes under CMDBf Response viewer | ||
| Generate Top 10 Log reports for CBE of access_log.cbe.xml and windows_app_log.cbe.xml | ||
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" CBE | ||
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" TomcatSet |
i9 ERs - JUnits/Manual Tests Inspection
To be added
i9 End2End Regression Tests
To be added
Basic Operational effeciency tests
To be added
i9 Test Execution Results
To be added