Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "COSMOS i11 QA Phase Execution"
(→QA i11 Execution Activities) |
(→1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0) |
||
Line 32: | Line 32: | ||
==1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0 == | ==1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0 == | ||
+ | |||
+ | ==E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0) == | ||
+ | |||
+ | {|{{BMTableStyle}} | ||
+ | |-{{BMTHStyle}} | ||
+ | ! Test Description | ||
+ | ! Test Status | ||
+ | Windows XP SP2 | ||
+ | ! Test Status | ||
+ | Windows 2003 SP1 | ||
+ | ! Test Status | ||
+ | RHES 5.0 | ||
+ | ! Remarks | ||
+ | |||
+ | |- | ||
+ | |'''Build Installation and Configuration''' | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |||
+ | |- | ||
+ | |<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <dojo-path> <axis2war-path> | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |'''Starting COSMOS components : Management Console''' | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |||
+ | |||
+ | |- | ||
+ | |<cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:8080/axis2/services/Broker | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> broker registerAllDataManagers | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |||
+ | |- | ||
+ | |COSMOS> broker getDataManagers | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> finddatamanagers http://localhost:8080/axis2/services/CosmosServiceFinder | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> broker deregister domsr01-xp StatDataManager | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> broker deregister domsr01-xp LoggingDataManager | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> broker deregister domsr01-xp TestFederatingCMDB | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> broker deregister domsr01-xp ExampleMdr | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> broker deregister domsr01-xp SMLMDR | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> broker deregister domsr01-xp AperiMdr | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testPropertyQuery.txt | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-teachers.txt | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\relationship-all-classes.txt | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\teaches-relationship.txt | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_all_items.txt | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_localid.txt | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_display_name.txt | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_relationship.txt | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |||
+ | |- | ||
+ | |COSMOS> COSMOS> graphQuery domsr01-xp TestFederatingCMDB D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\TestFederatingCMDB\all_items.txt | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Empty Response, no data found. | ||
+ | |||
+ | |- | ||
+ | |'''Using the COSMOS Web User Interface''' | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |||
+ | |- | ||
+ | |http://localhost:8080/COSMOSUI/?page=cosmos | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Found All 6 DataManagers under COSMOS Web UI | ||
+ | |- | ||
+ | |StatDataManager | ||
+ | server 33 tomcat1181829221515 CBE | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Statistical Report generated successfully | ||
+ | |- | ||
+ | |StatDataManager | ||
+ | server 33 tomcat1181829221515 TomcatSet | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Statistical Report generated successfully | ||
+ | |- | ||
+ | |LoggingDataManager | ||
+ | access_log.cbe.xml | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Top 10 Log Report generated successfully | ||
+ | |- | ||
+ | |LoggingDataManager | ||
+ | windows_app_log.cbe.xml | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Top 10 Log Report generated successfully | ||
+ | |- | ||
+ | |Sample Repository with Registration | ||
+ | Submit Query | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Query for all-items resulted Empty Reponse, no data found. | ||
+ | |- | ||
+ | |Sample Repository with Registration | ||
+ | Register Configuration Items... | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Registration with Example MDR is successful | ||
+ | |- | ||
+ | |Sample Repository with Registration | ||
+ | Deregister Configuration Items... | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Deregistration with Example MDR is successful | ||
+ | |- | ||
+ | |Sample Repository with Registration | ||
+ | Submit Query | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Query for all-items resulted Empty Reponse, no data found. | ||
+ | |- | ||
+ | |Sample Repository with Registration | ||
+ | View MetaData | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |No Metadata available | ||
+ | |- | ||
+ | |Resource Repository | ||
+ | Submit Query | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Queries executed successfully with proper results | ||
+ | |- | ||
+ | |Resource Repository | ||
+ | View MetaData | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |No Metadata available | ||
+ | |- | ||
+ | |AperiMDR | ||
+ | Submit Query | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Using Query builder able to execute and validate queries properly | ||
+ | |- | ||
+ | |AperiMDR | ||
+ | View MetaData | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Displayed MetaData properly | ||
+ | |- | ||
+ | |Sample Repository with Query | ||
+ | Get All Students | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Displayed Query Result for Students data correctly | ||
+ | |- | ||
+ | |Sample Repository with Query | ||
+ | Get All Teachers | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Displayed Query Result for Teachers data correctly | ||
+ | |- | ||
+ | |Sample Repository with Query | ||
+ | Get All Classes | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Displayed Query Result for Classes data correctly | ||
+ | |- | ||
+ | |Sample Repository with Query | ||
+ | Staff01 | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Displayed data for 'students taught by teacher-staff01' correctly | ||
+ | |- | ||
+ | |Sample Repository with Query | ||
+ | Staff02 | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Displayed data for 'students taught by teacher-staff02' correctly | ||
+ | |- | ||
+ | |Sample Repository with Query | ||
+ | Submit Query | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Using Query Builder, able to create and execute queries correctly | ||
+ | |- | ||
+ | |Sample Repository with Query | ||
+ | View MetaData | ||
+ | | | ||
+ | | | ||
+ | | | ||
+ | |Displayed MetaData information correctly | ||
+ | |} | ||
+ | |||
==2. i11 ERs – JUnits/Manual Tests inspection == | ==2. i11 ERs – JUnits/Manual Tests inspection == | ||
==3. Data Visualization TPTP Manual Tests Execution == | ==3. Data Visualization TPTP Manual Tests Execution == |
Revision as of 02:58, 16 June 2008
Contents
- 1 QA i11 Execution - Activities
- 2 QA i11 Execution - Complete Status
- 2.1 1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0
- 2.2 E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0)
- 2.3 2. i11 ERs – JUnits/Manual Tests inspection
- 2.4 3. Data Visualization TPTP Manual Tests Execution
- 2.5 4. Execution of i11 supplement e2e tests (negative) from QA.
- 2.6 5. Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)()
- 2.7 6. Basic operational efficiency tests (limited performance tests)
- 3 QA i11 Execution - Miscellaneous
QA i11 Execution - Activities
QA Test Execution Activities for i11
Primary Tasks:
1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0
2. i11 ERs – JUnits/Manual Tests inspection
3. Data Visualization TPTP Manual Tests Execution
- DataVisualization.UI.Component.Widget.testsuite / UI.Reports.testsuite
4. Execution of i11 supplement e2e tests (negative) from QA.
5. Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)()
- org.eclipse.cosmos.me.dmtoolkit.tests/ManagementEnablement.UI.dmtoolkit.testsuite
- SML Tooling - adhoc UI testing for editor/validator/import/export features
Secondary Tasks:
6. Basic operational efficiency tests (limited performance tests)
For complete i11 QA Activities, refer http://wiki.eclipse.org/COSMOS_QA_i10_Activities
QA i11 Test Execution Summary
QA i11 Execution - Complete Status
1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0
E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0)
Test Description | Test Status
Windows XP SP2 |
Test Status
Windows 2003 SP1 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|---|
Build Installation and Configuration | ||||
<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <dojo-path> <axis2war-path> | None | |||
Starting COSMOS components : Management Console |
| |||
<cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:8080/axis2/services/Broker | None | |||
COSMOS> broker registerAllDataManagers | ||||
COSMOS> broker getDataManagers | None | |||
COSMOS> finddatamanagers http://localhost:8080/axis2/services/CosmosServiceFinder | None | |||
COSMOS> broker deregister domsr01-xp StatDataManager | None | |||
COSMOS> broker deregister domsr01-xp LoggingDataManager | None | |||
COSMOS> broker deregister domsr01-xp TestFederatingCMDB | None | |||
COSMOS> broker deregister domsr01-xp ExampleMdr | None | |||
COSMOS> broker deregister domsr01-xp SMLMDR | None | |||
COSMOS> broker deregister domsr01-xp AperiMdr | None | |||
COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt | None | |||
COSMOS> graphQuery domsr01-xp SMLMDR D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testPropertyQuery.txt | None | |||
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt | None | |||
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-teachers.txt | None | |||
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\relationship-all-classes.txt | None | |||
COSMOS> graphQuery domsr01-xp ExampleMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\teaches-relationship.txt | None | |||
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_all_items.txt | None | |||
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_localid.txt | None | |||
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_display_name.txt | None | |||
COSMOS> graphQuery domsr01-xp AperiMdr D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\AperiMdr\StorageSystem_relationship.txt | None | |||
COSMOS> COSMOS> graphQuery domsr01-xp TestFederatingCMDB D:\cosmosi10\cosmos-demo\cosmos-client\cmdbfQuery\TestFederatingCMDB\all_items.txt | Empty Response, no data found. | |||
Using the COSMOS Web User Interface | ||||
http://localhost:8080/COSMOSUI/?page=cosmos | Found All 6 DataManagers under COSMOS Web UI | |||
StatDataManager
server 33 tomcat1181829221515 CBE |
Statistical Report generated successfully | |||
StatDataManager
server 33 tomcat1181829221515 TomcatSet |
Statistical Report generated successfully | |||
LoggingDataManager
access_log.cbe.xml |
Top 10 Log Report generated successfully | |||
LoggingDataManager
windows_app_log.cbe.xml |
Top 10 Log Report generated successfully | |||
Sample Repository with Registration
Submit Query |
Query for all-items resulted Empty Reponse, no data found. | |||
Sample Repository with Registration
Register Configuration Items... |
Registration with Example MDR is successful | |||
Sample Repository with Registration
Deregister Configuration Items... |
Deregistration with Example MDR is successful | |||
Sample Repository with Registration
Submit Query |
Query for all-items resulted Empty Reponse, no data found. | |||
Sample Repository with Registration
View MetaData |
No Metadata available | |||
Resource Repository
Submit Query |
Queries executed successfully with proper results | |||
Resource Repository
View MetaData |
No Metadata available | |||
AperiMDR
Submit Query |
Using Query builder able to execute and validate queries properly | |||
AperiMDR
View MetaData |
Displayed MetaData properly | |||
Sample Repository with Query
Get All Students |
Displayed Query Result for Students data correctly | |||
Sample Repository with Query
Get All Teachers |
Displayed Query Result for Teachers data correctly | |||
Sample Repository with Query
Get All Classes |
Displayed Query Result for Classes data correctly | |||
Sample Repository with Query
Staff01 |
Displayed data for 'students taught by teacher-staff01' correctly | |||
Sample Repository with Query
Staff02 |
Displayed data for 'students taught by teacher-staff02' correctly | |||
Sample Repository with Query
Submit Query |
Using Query Builder, able to create and execute queries correctly | |||
Sample Repository with Query
View MetaData |
Displayed MetaData information correctly |