Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
COSMOS i9 QA Phase Execution
Revision as of 02:50, 26 February 2008 by Unnamed Poltroon (Talk) (→i9 ERs - JUnits/Manual Tests Inspection)
This page created per the request from QA to track all i9 test execution activities from 25 Feb'08 to 07 Mar'08. This page will be filled in by the QA team as i9 testing phase proceeds.
Contents
QA Test Execution Activities for i9
Primary Tasks:
- E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0 (http://wiki.eclipse.org/COSMOS_DEMO_i9 )
- i9 ERs (17 ERs) – JUnits/Manual Tests inspection (http://wiki.eclipse.org/Cosmos1.0Features#Iteration_9_Enhancements)
Secondary Tasks:
- Execution of i9 supplement test cases for above End2End scenarios.
- Basic operational efficiency tests (limited performance tests)
E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0)
Build Id: COSMOS-1.0.0-200802221728
| Test Description | Test Status
Windows XP SP2 |
Test Status
Windows 2003 SP1 |
Test Status
RHES 5.0 |
Remarks |
|---|---|---|---|---|
| Build Installation and Configuration
<cosmos-demo>/bin/configDemo.bat |
Passed | Passed | Passed | None |
| Starting COSMOS components
<tomcat-install-dir>/bin/startup.bat |
Passed | Passed | Passed | All 5 Data Managers started successfully |
| Get Brokers registered at Management Domain
COSMOS> domain getBrokers |
Passed | Passed | Passed | None |
| Get Data Managers register at the Broker
COSMOS> broker getDataManagers |
||||
| CMDBf Query Execution
COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testInstanceIdQuery.txt |
||||
| COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testPropertyQuery.txt | ||||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-students.txt | ||||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-teachers.txt | ||||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\relationship-all-
classes.txt |
||||
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\teaches-relationship.txt | ||||
| RegistrationExample ??? | ||||
| Data Manager Services : Collecting Log Events from Logging Data Manager
logging getDatasets |
||||
| logging getAllCBE access_log.cbe.xml | ||||
| logging getCBECountBySeverity access_log.cbe.xml | ||||
| logging getAllCBE windows_app_log.cbe.xml | ||||
| logging getCBECountBySeverity access_log.cbe.xml | ||||
| Data Manager Services : Collect webserver performance data from Statistical Data Manger | ||||
| stat getDatasourceKeyset | ||||
| stat getStatDataForSource "server 33 tomcat1181829221515" CBE | ||||
| stat getStatDataForSource "server 33 tomcat1181829221515" TomcatSet | ||||
| COSMOS Web User Interface tests (should be verified on both IE and Firefox)
Open http://localhost:8080/COSMOSUI/?page=cosmos (shd display 5 Data Managers nodes) |
||||
| Expand Statistical and CBE Nodes | ||||
| Verify the properties of all 5 nodes under Properties pane | ||||
| Run all available CMDBf queries on SMLMDR and verify CMDBf response viewer | ||||
| Run all available CMDBf queries on EXAMPLEMDR and verify CMDBf response viewer | ||||
| Run all available CMDBf queries on RegisterationExample and verify CMDBf response viewer | ||||
| Inspect all nodes under CMDBf Response viewer | ||||
| Generate Top 10 Log reports for CBE of access_log.cbe.xml and windows_app_log.cbe.xml | ||||
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" CBE | ||||
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" TomcatSet |
i9 ERs - JUnits/Manual Tests Inspection
| Bugzilla ID | ID Summary | JUnits Status | Manual Tests | Remarks |
|---|---|---|---|---|
| 216210 | Define & document COSMOS 1.0 hardware & software operational guidelines, recommendations, and best practices | NA | NA | This ER refers to documentation |
| 216332 | Complete design for COSMOS Security - phase 2 | NA | NA | This ER refers to documentation |
| 215123 | Complete CMDBf 1.0 Service Metadata implementation | NA | Available | Manual Tests available under Design Doc. |
| 214672 | Registration of MDR configuration items with a federating CMDB | NA | NA | No Manual Tests/JUnits available |
| 216211 | We need an ongoing build process to facilitate a continuous test loop | NA | NA | This ER refers to Documentation |
| 205826 | Update DataCenter model based on latest SML changes | NA | NA | This ER refers to Documentation |
| 217301 | Visualizing a CMDBf status response | NA | NA | No Manual Tests/JUnits available |
| 214794 | "Generic" metadata driven CMDBf Query Builder | Available | Available | Manual Tests & JUnits available (JUnits CVS path is missing) |
| 217337 | Generate JSON outputter for generic CMDBf Graph Response View | |||
| 208274 | Create a data manager toolkit that will allow adopters to easily register and use a data provider inside COSMOS framework | |||
| 215267 | Provide support for adding a federating CMDB to COSMOS framework | |||
| 214145 | Generic CMDBf Graph Response View | |||
| 209980 | MDR (and Data Manager) deployment outside of OSGi environment | |||
| 214903 | Provide a mechanism for testing the registration service and client | |||
| 216529 | Define scope and detail the i9 QA activities | |||
| 220181 | Complete the i9 QA activities | |||
| 205825 | Update SML validator implementation based on changes to the SML latest draft |
i9 End2End Regression Tests
To be added
Basic Operational effeciency tests
To be added
i9 Test Execution Results
To be added