Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "COSMOS i9 QA Phase Execution"
(→E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0)) |
(→E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0)) |
||
| Line 12: | Line 12: | ||
==E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0) == | ==E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0) == | ||
| − | |||
| − | |||
| − | |||
'''Build ID: COSMOS-1.0.0-200802261616 | '''Build ID: COSMOS-1.0.0-200802261616 | ||
http://www.eclipse.org/cosmos/downloads/?buildId=COSMOS-1.0.0-200802261616''' | http://www.eclipse.org/cosmos/downloads/?buildId=COSMOS-1.0.0-200802261616''' | ||
| + | Last updated : --[[User:Domsr01.ca.com|Domsr01.ca.com]] 07:24, 28 February 2008 (EST) | ||
{|{{BMTableStyle}} | {|{{BMTableStyle}} | ||
| Line 35: | Line 33: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|None | |None | ||
|- | |- | ||
| Line 42: | Line 40: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|All 5 Data Managers started successfully | |All 5 Data Managers started successfully | ||
|- | |- | ||
| Line 49: | Line 47: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Listed Broker EPR successfully | |Listed Broker EPR successfully | ||
|- | |- | ||
| Line 56: | Line 54: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Listed All 5 Data Managers EPRs | |Listed All 5 Data Managers EPRs | ||
|- | |- | ||
| Line 63: | Line 61: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Query Executed Successfully | |Query Executed Successfully | ||
|- | |- | ||
| Line 69: | Line 67: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Query Executed Successfully | |Query Executed Successfully | ||
|- | |- | ||
| Line 75: | Line 73: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Query Executed Successfully | |Query Executed Successfully | ||
|- | |- | ||
| Line 81: | Line 79: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Query Executed Successfully | |Query Executed Successfully | ||
|- | |- | ||
| Line 88: | Line 86: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Query Executed Successfully | |Query Executed Successfully | ||
|- | |- | ||
| Line 94: | Line 92: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Query Executed Successfully | |Query Executed Successfully | ||
|- | |- | ||
| − | | | + | |COSMOS>examplemdr getWSD |
| − | + | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
| − | | | + | |Displayed WSDL information from Example MDR |
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
| − | + | ||
|- | |- | ||
|'''Data Manager Services : Collecting Log Events from Logging Data Manager''' | |'''Data Manager Services : Collecting Log Events from Logging Data Manager''' | ||
| Line 114: | Line 105: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Listed 2 DataSources successfully | |Listed 2 DataSources successfully | ||
|- | |- | ||
| Line 120: | Line 111: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Diplayed long list of CommonBaseEvent objects obtained from the logfile specified | |Diplayed long list of CommonBaseEvent objects obtained from the logfile specified | ||
|- | |- | ||
| Line 126: | Line 117: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Displayed event type summary from the logfile specified | |Displayed event type summary from the logfile specified | ||
|- | |- | ||
| Line 132: | Line 123: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Diplayed long list of CommonBaseEvent objects obtained from the logfile specified | |Diplayed long list of CommonBaseEvent objects obtained from the logfile specified | ||
|- | |- | ||
| Line 138: | Line 129: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Displayed event type summary from the logfile specified | |Displayed event type summary from the logfile specified | ||
|- | |- | ||
| Line 145: | Line 136: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Displayed dataset/keyset combinations available | |Displayed dataset/keyset combinations available | ||
|- | |- | ||
| Line 151: | Line 142: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Displayed formatted output for the given dataset/keyset | |Displayed formatted output for the given dataset/keyset | ||
|- | |- | ||
| Line 157: | Line 148: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Displayed formatted output for the given dataset/keyset | |Displayed formatted output for the given dataset/keyset | ||
|- | |- | ||
| Line 164: | Line 155: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Displayed 5 Data Manager nodes (Statistical,SML MDR,Example MDR,Registration Example,CBE) successfully | |Displayed 5 Data Manager nodes (Statistical,SML MDR,Example MDR,Registration Example,CBE) successfully | ||
|- | |- | ||
| Line 170: | Line 161: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Diplayed 2 Dataset/keyset values successfully | |Diplayed 2 Dataset/keyset values successfully | ||
|- | |- | ||
| Line 176: | Line 167: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Diplayed 2 log file names successfully | |Diplayed 2 log file names successfully | ||
|- | |- | ||
| Line 182: | Line 173: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|All properties values are rendering properly | |All properties values are rendering properly | ||
|- | |- | ||
| − | | | + | |Using SMLMDR and verify CMDBf response viewer |
| − | + | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| + | | | ||
|All existing SMLMDR CMDBf queries executed properly | |All existing SMLMDR CMDBf queries executed properly | ||
|- | |- | ||
| − | | | + | |Using EXAMPLE MDR Query Builder and verifying CMDBf response viewer |
| − | | | + | |Passed |
| − | | | + | |Passed |
| − | + | ||
| | | | ||
| + | |Query Builded successfully and displayed all data properly under CMDBf Response Viewer | ||
|- | |- | ||
| − | | | + | |'''RegistrationExample ''' |
| − | + | Registering configuration items with the test Federating CMDB | |
| − | | | + | |Passed |
| − | | | + | |Passed |
| | | | ||
| + | |Registered configured items successfully | ||
|- | |- | ||
| − | | | + | |Deregistering configuration items with the test Federating CMDB |
| − | + | |Passed | |
| − | | | + | |Passed |
| − | | | + | |
| | | | ||
| + | |Deregistered configured items successfully | ||
|- | |- | ||
|Generate Top 10 Log reports for CBE of access_log.cbe.xml | |Generate Top 10 Log reports for CBE of access_log.cbe.xml | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Generated Top 10 Log reports for access_log_cbe.xml successfully | |Generated Top 10 Log reports for access_log_cbe.xml successfully | ||
|- | |- | ||
| Line 218: | Line 210: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Generated Top 10 Log reports for windows_app_log.cbe.xml file successfully | |Generated Top 10 Log reports for windows_app_log.cbe.xml file successfully | ||
|- | |- | ||
| Line 224: | Line 216: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Generated Stat report for given CBE dataset/keyset values successfully | |Generated Stat report for given CBE dataset/keyset values successfully | ||
|- | |- | ||
| Line 230: | Line 222: | ||
|Passed | |Passed | ||
|Passed | |Passed | ||
| − | | | + | | |
|Generated Stat report for given TomcatSet dataset/keyset values successfully | |Generated Stat report for given TomcatSet dataset/keyset values successfully | ||
|} | |} | ||
Revision as of 08:24, 28 February 2008
This page created per the request from QA to track all i9 test execution activities from 25 Feb'08 to 07 Mar'08. This page will be filled in by the QA team as i9 testing phase proceeds.
Contents
QA Test Execution Activities for i9
Primary Tasks:
- E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0 (http://wiki.eclipse.org/COSMOS_DEMO_i9 )
- i9 ERs (17 ERs) – JUnits/Manual Tests inspection (http://wiki.eclipse.org/Cosmos1.0Features#Iteration_9_Enhancements)
Secondary Tasks:
- Execution of i9 supplement test cases for above End2End scenarios.
- Basic operational efficiency tests (limited performance tests)
E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0)
Build ID: COSMOS-1.0.0-200802261616 http://www.eclipse.org/cosmos/downloads/?buildId=COSMOS-1.0.0-200802261616
Last updated : --Domsr01.ca.com 07:24, 28 February 2008 (EST)
| Test Description | Test Status
Windows XP SP2 |
Test Status
Windows 2003 SP1 |
Test Status
RHES 5.0 |
Remarks |
|---|---|---|---|---|
| Build Installation and Configuration
<cosmos-demo>/bin/configDemo.bat |
Passed | Passed | None | |
| Starting COSMOS components
<tomcat-install-dir>/bin/startup.bat |
Passed | Passed | All 5 Data Managers started successfully | |
| Get Brokers registered at Management Domain
COSMOS> domain getBrokers |
Passed | Passed | Listed Broker EPR successfully | |
| Get Data Managers register at the Broker
COSMOS> broker getDataManagers |
Passed | Passed | Listed All 5 Data Managers EPRs | |
| CMDBf Query Execution
COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testInstanceIdQuery.txt |
Passed | Passed | Query Executed Successfully | |
| COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testPropertyQuery.txt | Passed | Passed | Query Executed Successfully | |
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-students.txt | Passed | Passed | Query Executed Successfully | |
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-teachers.txt | Passed | Passed | Query Executed Successfully | |
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\relationship-all-
classes.txt |
Passed | Passed | Query Executed Successfully | |
| COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\teaches-relationship.txt | Passed | Passed | Query Executed Successfully | |
| COSMOS>examplemdr getWSD | Passed | Passed | Displayed WSDL information from Example MDR | |
| Data Manager Services : Collecting Log Events from Logging Data Manager
logging getDatasets |
Passed | Passed | Listed 2 DataSources successfully | |
| logging getAllCBE access_log.cbe.xml | Passed | Passed | Diplayed long list of CommonBaseEvent objects obtained from the logfile specified | |
| logging getCBECountBySeverity access_log.cbe.xml | Passed | Passed | Displayed event type summary from the logfile specified | |
| logging getAllCBE windows_app_log.cbe.xml | Passed | Passed | Diplayed long list of CommonBaseEvent objects obtained from the logfile specified | |
| logging getCBECountBySeverity access_log.cbe.xml | Passed | Passed | Displayed event type summary from the logfile specified | |
| Data Manager Services : Collect webserver performance data from Statistical Data Manager
stat getDatasourceKeyset |
Passed | Passed | Displayed dataset/keyset combinations available | |
| stat getStatDataForSource "server 33 tomcat1181829221515" CBE | Passed | Passed | Displayed formatted output for the given dataset/keyset | |
| stat getStatDataForSource "server 33 tomcat1181829221515" TomcatSet | Passed | Passed | Displayed formatted output for the given dataset/keyset | |
| COSMOS Web User Interface tests (should be verified on both IE and Firefox)
Open http://localhost:8080/COSMOSUI/?page=cosmos (shd display 5 Data Managers nodes) |
Passed | Passed | Displayed 5 Data Manager nodes (Statistical,SML MDR,Example MDR,Registration Example,CBE) successfully | |
| Expand Statistical node and check for Dataset/Keyset values | Passed | Passed | Diplayed 2 Dataset/keyset values successfully | |
| Expand CBE node and check for 2 log files | Passed | Passed | Diplayed 2 log file names successfully | |
| Verify the properties of all 5 nodes under Properties pane | Passed | Passed | All properties values are rendering properly | |
| Using SMLMDR and verify CMDBf response viewer | Passed | Passed | All existing SMLMDR CMDBf queries executed properly | |
| Using EXAMPLE MDR Query Builder and verifying CMDBf response viewer | Passed | Passed | Query Builded successfully and displayed all data properly under CMDBf Response Viewer | |
| RegistrationExample
Registering configuration items with the test Federating CMDB |
Passed | Passed | Registered configured items successfully | |
| Deregistering configuration items with the test Federating CMDB | Passed | Passed | Deregistered configured items successfully | |
| Generate Top 10 Log reports for CBE of access_log.cbe.xml | Passed | Passed | Generated Top 10 Log reports for access_log_cbe.xml successfully | |
| Generate Top 10 Log reports for CBE of windows_app_log.cbe.xml | Passed | Passed | Generated Top 10 Log reports for windows_app_log.cbe.xml file successfully | |
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" CBE | Passed | Passed | Generated Stat report for given CBE dataset/keyset values successfully | |
| Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" TomcatSet | Passed | Passed | Generated Stat report for given TomcatSet dataset/keyset values successfully |
i9 ERs - JUnits/Manual Tests Inspection
| Bugzilla ID | ID Summary | JUnits Status | Manual Tests | Remarks |
|---|---|---|---|---|
| 216210 | Define & document COSMOS 1.0 hardware & software operational guidelines, recommendations, and best practices | NA | NA | This ER refers to documentation |
| 216332 | Complete design for COSMOS Security - phase 2 | NA | NA | This ER refers to documentation |
| 215123 | Complete CMDBf 1.0 Service Metadata implementation | NA | Available | Manual Tests available under Design Doc. |
| 214672 | Registration of MDR configuration items with a federating CMDB | NA | NA | No Manual Tests/JUnits available |
| 216211 | We need an ongoing build process to facilitate a continuous test loop | NA | NA | This ER refers to Documentation |
| 205826 | Update DataCenter model based on latest SML changes | NA | NA | This ER refers to Documentation |
| 217301 | Visualizing a CMDBf status response | NA | NA | No Manual Tests/JUnits available |
| 214794 | "Generic" metadata driven CMDBf Query Builder | Available | Available | Manual Tests & JUnits available (JUnits CVS path is missing) |
| 217337 | Generate JSON outputter for generic CMDBf Graph Response View | NA | Available | Manual Tests available under Design Doc |
| 208274 | Create a data manager toolkit that will allow adopters to easily register and use a data provider inside COSMOS framework | NA | Available | Manual TPTP tests available under CVS |
| 215267 | Provide support for adding a federating CMDB to COSMOS framework | NA | NA | No Manual/JUnits tests available |
| 214145 | Generic CMDBf Graph Response View | NA | Available | Manual Tests available under Design Doc |
| 209980 | MDR (and Data Manager) deployment outside of OSGi environment | NA | NA | This ER refers to Build (WAR file deployment under Tomcat) |
| 214903 | Provide a mechanism for testing the registration service and client | NA | NA | No Manual Tests/JUnits available |
| 216529 | Define scope and detail the i9 QA activities | NA | NA | This ER refers to Documentation |
| 220181 | Complete the i9 QA activities | NA | NA | This ER refers to Documentation |
| 205825 | Update SML validator implementation based on changes to the SML latest draft | NA | NA | This ER referes to SML-IF Documentation |
i9 End2End Supplement Tests
To be added
Basic Operational effeciency tests
To be added
i9 Test Execution Results
To be added