Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "COSMOS i9 QA Phase Execution"
(→E2E testing status (Windows XP SP2)) |
|||
| Line 19: | Line 19: | ||
! Test Description | ! Test Description | ||
! Test Status | ! Test Status | ||
| + | Windows XP SP2 | ||
| + | ! Test Status | ||
| + | Windows 2003 SP1 | ||
| + | ! Test Status | ||
| + | RHES 5.0 | ||
! Remarks | ! Remarks | ||
|- | |- | ||
|Build Installation and Configuration | |Build Installation and Configuration | ||
<cosmos-demo>/bin/configDemo.bat | <cosmos-demo>/bin/configDemo.bat | ||
| + | |Passed | ||
| + | |Passed | ||
|Passed | |Passed | ||
|None | |None | ||
| Line 28: | Line 35: | ||
|Starting COSMOS components | |Starting COSMOS components | ||
<tomcat-install-dir>/bin/startup.bat | <tomcat-install-dir>/bin/startup.bat | ||
| + | |Passed | ||
| + | |Passed | ||
|Passed | |Passed | ||
|All 5 Data Managers started successfully | |All 5 Data Managers started successfully | ||
| Line 33: | Line 42: | ||
|Get Brokers registered at Management Domain | |Get Brokers registered at Management Domain | ||
COSMOS> domain getBrokers | COSMOS> domain getBrokers | ||
| + | |Passed | ||
| + | |Passed | ||
|Passed | |Passed | ||
|None | |None | ||
| Line 38: | Line 49: | ||
|Get Data Managers register at the Broker | |Get Data Managers register at the Broker | ||
COSMOS> broker getDataManagers | COSMOS> broker getDataManagers | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
| Line 43: | Line 56: | ||
|CMDBf Query Execution | |CMDBf Query Execution | ||
COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testInstanceIdQuery.txt | COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testInstanceIdQuery.txt | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testPropertyQuery.txt | |COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testPropertyQuery.txt | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-students.txt | |COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-students.txt | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-teachers.txt | |COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-teachers.txt | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
| Line 60: | Line 81: | ||
|COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\relationship-all- | |COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\relationship-all- | ||
classes.txt | classes.txt | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\teaches-relationship.txt | |COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\teaches-relationship.txt | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|RegistrationExample ??? | |RegistrationExample ??? | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
| Line 73: | Line 100: | ||
|Data Manager Services : Collecting Log Events from Logging Data Manager | |Data Manager Services : Collecting Log Events from Logging Data Manager | ||
logging getDatasets | logging getDatasets | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|logging getAllCBE access_log.cbe.xml | |logging getAllCBE access_log.cbe.xml | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|logging getCBECountBySeverity access_log.cbe.xml | |logging getCBECountBySeverity access_log.cbe.xml | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|logging getAllCBE windows_app_log.cbe.xml | |logging getAllCBE windows_app_log.cbe.xml | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|logging getCBECountBySeverity access_log.cbe.xml | |logging getCBECountBySeverity access_log.cbe.xml | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|Data Manager Services : Collect webserver performance data from Statistical Data Manger | |Data Manager Services : Collect webserver performance data from Statistical Data Manger | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|stat getDatasourceKeyset | |stat getDatasourceKeyset | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|stat getStatDataForSource "server 33 tomcat1181829221515" CBE | |stat getStatDataForSource "server 33 tomcat1181829221515" CBE | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|stat getStatDataForSource "server 33 tomcat1181829221515" TomcatSet | |stat getStatDataForSource "server 33 tomcat1181829221515" TomcatSet | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
| Line 110: | Line 155: | ||
|COSMOS Web User Interface tests (should be verified on both IE and Firefox) | |COSMOS Web User Interface tests (should be verified on both IE and Firefox) | ||
Open http://localhost:8080/COSMOSUI/?page=cosmos (shd display 5 Data Managers nodes) | Open http://localhost:8080/COSMOSUI/?page=cosmos (shd display 5 Data Managers nodes) | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|Expand Statistical and CBE Nodes | |Expand Statistical and CBE Nodes | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|Verify the properties of all 5 nodes under Properties pane | |Verify the properties of all 5 nodes under Properties pane | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|Run all available CMDBf queries on SMLMDR and verify CMDBf response viewer | |Run all available CMDBf queries on SMLMDR and verify CMDBf response viewer | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|Run all available CMDBf queries on EXAMPLEMDR and verify CMDBf response viewer | |Run all available CMDBf queries on EXAMPLEMDR and verify CMDBf response viewer | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|Run all available CMDBf queries on RegisterationExample and verify CMDBf response viewer | |Run all available CMDBf queries on RegisterationExample and verify CMDBf response viewer | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|Inspect all nodes under CMDBf Response viewer | |Inspect all nodes under CMDBf Response viewer | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|Generate Top 10 Log reports for CBE of access_log.cbe.xml and windows_app_log.cbe.xml | |Generate Top 10 Log reports for CBE of access_log.cbe.xml and windows_app_log.cbe.xml | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" CBE | |Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" CBE | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|- | |- | ||
|Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" TomcatSet | |Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" TomcatSet | ||
| + | | | ||
| + | | | ||
| | | | ||
| | | | ||
|} | |} | ||
| − | |||
==E2E testing status (Red Hat Enterprise Linux Server 5.0) == | ==E2E testing status (Red Hat Enterprise Linux Server 5.0) == | ||
Revision as of 01:55, 26 February 2008
This page created per the request from QA to track all i9 test execution activities from 25 Feb'08 to 07 Mar'08. This page will be filled in by the QA team as i9 testing phase proceeds.
Contents
- 1 QA Test Execution Activities for i9
- 2 E2E testing status (Windows XP SP2)
- 3 E2E testing status (Red Hat Enterprise Linux Server 5.0)
- 4 E2E testing status (Windows 2003 SP1)
- 5 i9 ERs - JUnits/Manual Tests Inspection
- 6 i9 End2End Regression Tests
- 7 Basic Operational effeciency tests
- 8 i9 Test Execution Results
QA Test Execution Activities for i9
Primary Tasks:
- E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0 (http://wiki.eclipse.org/COSMOS_DEMO_i9 )
- i9 ERs (16 ERs) – JUnits/Manual Tests inspection (Bugzilla: i9 Enhancements)
Secondary Tasks:
- Execution of regression test cases for all End2End scenarios.
- Basic operational efficiency tests (limited performance tests)
E2E testing status (Windows XP SP2)
Build Id: COSMOS-1.0.0-200802221728
| Test Description | Test Status
Windows XP SP2 |
Test Status
Windows 2003 SP1 |
Test Status
RHES 5.0 |
Remarks |
|---|---|---|---|---|
| Build Installation and Configuration
<cosmos-demo>/bin/configDemo.bat |
Passed | Passed | Passed | None |
| Starting COSMOS components
<tomcat-install-dir>/bin/startup.bat |
Passed | Passed | Passed | All 5 Data Managers started successfully |
| Get Brokers registered at Management Domain
COSMOS> domain getBrokers |
Passed | Passed | Passed | None |
| Get Data Managers register at the Broker
COSMOS> broker getDataManagers |
||||
| CMDBf Query Execution
COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testInstanceIdQuery.txt |
||||
| COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testPropertyQuery.txt | ||||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-students.txt | ||||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-teachers.txt | ||||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\relationship-all-
classes.txt |
||||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\teaches-relationship.txt | ||||
| RegistrationExample ??? | ||||
| Data Manager Services : Collecting Log Events from Logging Data Manager
logging getDatasets |
||||
| logging getAllCBE access_log.cbe.xml | ||||
| logging getCBECountBySeverity access_log.cbe.xml | ||||
| logging getAllCBE windows_app_log.cbe.xml | ||||
| logging getCBECountBySeverity access_log.cbe.xml | ||||
| Data Manager Services : Collect webserver performance data from Statistical Data Manger | ||||
| stat getDatasourceKeyset | ||||
| stat getStatDataForSource "server 33 tomcat1181829221515" CBE | ||||
| stat getStatDataForSource "server 33 tomcat1181829221515" TomcatSet | ||||
| COSMOS Web User Interface tests (should be verified on both IE and Firefox)
Open http://localhost:8080/COSMOSUI/?page=cosmos (shd display 5 Data Managers nodes) |
||||
| Expand Statistical and CBE Nodes | ||||
| Verify the properties of all 5 nodes under Properties pane | ||||
| Run all available CMDBf queries on SMLMDR and verify CMDBf response viewer | ||||
| Run all available CMDBf queries on EXAMPLEMDR and verify CMDBf response viewer | ||||
| Run all available CMDBf queries on RegisterationExample and verify CMDBf response viewer | ||||
| Inspect all nodes under CMDBf Response viewer | ||||
| Generate Top 10 Log reports for CBE of access_log.cbe.xml and windows_app_log.cbe.xml | ||||
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" CBE | ||||
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" TomcatSet |
E2E testing status (Red Hat Enterprise Linux Server 5.0)
Build Id: COSMOS-1.0.0-200802221728
| Test Description | Test Status | Remarks |
|---|---|---|
| Build Installation and Configuration
<cosmos-demo>/bin/configDemo.bat |
||
| Starting COSMOS components
<tomcat-install-dir>/bin/startup.bat |
||
| Get Brokers registered at Management Domain
COSMOS> domain getBrokers |
||
| Get Data Managers register at the Broker
COSMOS> broker getDataManagers |
||
| CMDBf Query Execution
COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testInstanceIdQuery.txt |
||
| COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testPropertyQuery.txt | ||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-students.txt | ||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-teachers.txt | ||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\relationship-all-
classes.txt |
||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\teaches-relationship.txt | ||
| RegistrationExample ??? | ||
| Data Manager Services : Collecting Log Events from Logging Data Manager
logging getDatasets |
||
| logging getAllCBE access_log.cbe.xml | ||
| logging getCBECountBySeverity access_log.cbe.xml | ||
| logging getAllCBE windows_app_log.cbe.xml | ||
| logging getCBECountBySeverity access_log.cbe.xml | ||
| Data Manager Services : Collect webserver performance data from Statistical Data Manger | ||
| stat getDatasourceKeyset | ||
| stat getStatDataForSource "server 33 tomcat1181829221515" CBE | ||
| stat getStatDataForSource "server 33 tomcat1181829221515" TomcatSet | ||
| COSMOS Web User Interface tests (should be verified on both IE and Firefox)
Open http://localhost:8080/COSMOSUI/?page=cosmos (shd display 5 Data Managers nodes) |
||
| Expand Statistical and CBE Nodes | ||
| Verify the properties of all 5 nodes under Properties pane | ||
| Run all available CMDBf queries on SMLMDR and verify CMDBf response viewer | ||
| Run all available CMDBf queries on EXAMPLEMDR and verify CMDBf response viewer | ||
| Run all available CMDBf queries on RegisterationExample and verify CMDBf response viewer | ||
| Inspect all nodes under CMDBf Response viewer | ||
| Generate Top 10 Log reports for CBE of access_log.cbe.xml and windows_app_log.cbe.xml | ||
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" CBE | ||
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" TomcatSet |
E2E testing status (Windows 2003 SP1)
Build Id: COSMOS-1.0.0-200802221728
| Test Description | Test Status | Remarks |
|---|---|---|
| Build Installation and Configuration
<cosmos-demo>/bin/configDemo.bat |
||
| Starting COSMOS components
<tomcat-install-dir>/bin/startup.bat |
||
| Get Brokers registered at Management Domain
COSMOS> domain getBrokers |
||
| Get Data Managers register at the Broker
COSMOS> broker getDataManagers |
||
| CMDBf Query Execution
COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testInstanceIdQuery.txt |
||
| COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testPropertyQuery.txt | ||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-students.txt | ||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-teachers.txt | ||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\relationship-all-
classes.txt |
||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\teaches-relationship.txt | ||
| RegistrationExample ??? | ||
| Data Manager Services : Collecting Log Events from Logging Data Manager
logging getDatasets |
||
| logging getAllCBE access_log.cbe.xml | ||
| logging getCBECountBySeverity access_log.cbe.xml | ||
| logging getAllCBE windows_app_log.cbe.xml | ||
| logging getCBECountBySeverity access_log.cbe.xml | ||
| Data Manager Services : Collect webserver performance data from Statistical Data Manger | ||
| stat getDatasourceKeyset | ||
| stat getStatDataForSource "server 33 tomcat1181829221515" CBE | ||
| stat getStatDataForSource "server 33 tomcat1181829221515" TomcatSet | ||
| COSMOS Web User Interface tests (should be verified on both IE and Firefox)
Open http://localhost:8080/COSMOSUI/?page=cosmos (shd display 5 Data Managers nodes) |
||
| Expand Statistical and CBE Nodes | ||
| Verify the properties of all 5 nodes under Properties pane | ||
| Run all available CMDBf queries on SMLMDR and verify CMDBf response viewer | ||
| Run all available CMDBf queries on EXAMPLEMDR and verify CMDBf response viewer | ||
| Run all available CMDBf queries on RegisterationExample and verify CMDBf response viewer | ||
| Inspect all nodes under CMDBf Response viewer | ||
| Generate Top 10 Log reports for CBE of access_log.cbe.xml and windows_app_log.cbe.xml | ||
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" CBE | ||
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" TomcatSet |
i9 ERs - JUnits/Manual Tests Inspection
To be added
i9 End2End Regression Tests
To be added
Basic Operational effeciency tests
To be added
i9 Test Execution Results
To be added