Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
COSMOS i11 QA Phase Execution
Contents
- 1 QA i11 Execution - Activities
- 2 QA i11 Execution - Complete Status
- 2.1 1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0
- 2.2 2. i11 ERs – JUnits/Manual Tests inspection
- 2.3 3. Data Visualization TPTP Manual Tests Execution
- 2.4 4. Execution of i11 supplement e2e tests (negative) from QA.
- 2.5 5. Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)
- 2.6 6. Basic operational efficiency tests (limited performance tests)
- 3 QA i11 Execution - Miscellaneous
QA i11 Execution - Activities
QA Test Execution Activities for i11
Primary Tasks:
1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0
2. i11 ERs – JUnits/Manual Tests inspection
3. Data Visualization TPTP Manual Tests Execution
- DataVisualization.UI.Component.Widget.testsuite / UI.Reports.testsuite
4. Execution of i11 supplement e2e tests (negative) from QA.
5. Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)()
- org.eclipse.cosmos.me.dmtoolkit.tests/ManagementEnablement.UI.dmtoolkit.testsuite
- SML Tooling - adhoc UI testing for editor/validator/import/export features
Secondary Tasks:
6. Basic operational efficiency tests (limited performance tests)
For complete i11 QA Activities, refer http://wiki.eclipse.org/COSMOS_QA_i11_Activities
QA i11 Test Execution Summary
- Build ID: COSMOS-1.0.0-200806252052
- URL: http://www.eclipse.org/cosmos/downloads/?buildId=COSMOS-1.0.0-200806252052
The following activities were completed by QA, as per defined scope of i11 QA's primary activities (http://wiki.eclipse.org/COSMOS_QA_i11_Activities)
- E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0
- i11 ERs – JUnits/Manual Tests inspection
- Data Visualization TPTP Manual Tests Execution
- DataVisualization.UI.Component.Widget.testsuite / UI.Reports.testsuite
- Execution of i11 supplement e2e tests (negative) from QA.
- Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)
- org.eclipse.cosmos.me.dmtoolkit.tests/ManagementEnablement.UI.dmtoolkit.testsuite
- SML Tooling - adhoc UI testing for editor/validator/import/export features
Bugs Reported:
- https://bugs.eclipse.org/bugs/show_bug.cgi?id=237454
- https://bugs.eclipse.org/bugs/show_bug.cgi?id=238227
- https://bugs.eclipse.org/bugs/show_bug.cgi?id=237265
- https://bugs.eclipse.org/bugs/show_bug.cgi?id=238114
- https://bugs.eclipse.org/bugs/show_bug.cgi?id=238372
- https://bugs.eclipse.org/bugs/show_bug.cgi?id=238373
- https://bugs.eclipse.org/bugs/show_bug.cgi?id=238396
- https://bugs.eclipse.org/bugs/show_bug.cgi?id=238114
- https://bugs.eclipse.org/bugs/show_bug.cgi?id=237930
- https://bugs.eclipse.org/bugs/show_bug.cgi?id=237269
- https://bugs.eclipse.org/bugs/show_bug.cgi?id=237455
QA i11 Execution - Complete Status
- Refer test cases at http://wiki.eclipse.org/COSMOS_QA_End2End_Tests#COSMOS_End2End_Tests
- Refer COSMOS i11 demo page - http://wiki.eclipse.org/COSMOS_DEMO_i11
1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0
Build Installation and Configuration
Test Description | Test Status
Windows XP SP2 |
Test Status
Windows 2003 SP1 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|---|
1.Download COSMOS Demo and Prerequisites | Passed | Passed | Passed | None |
2.Installing COSMOS Web applications and Web Services
<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <dojo-path> <axis2war-path> |
Passed | Passed | Passed | None |
3.Installing COSMOS SDK | Passed | Passed | Passed | None |
4.Installing Resource Modeling Tooling | Passed | Passed | Passed | None |
COSMOS Command Line Client
Test Description | Test Status
Windows XP SP2 |
Test Status
Windows 2003 SP1 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|---|
1. Start the COSMOS Command Line Client
<cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:8080/axis2/services/Broker |
Passed | Passed | Passed | None |
2. Security Header - Set SoapVersion
COSMOS> set soapversion 12 |
Passed | Passed | Passed | None |
3. Security Header - Set Username
COSMOS> set username test |
Passed | Passed | Passed | None |
4. Security Header - Set Password
COSMOS> set password test123 |
Passed | Passed | Passed | None |
5. Security Header - Show Details
COSMOS> Show |
Passed | Passed | Passed | None |
6. Register All Data Managers with Broker
COSMOS> broker registerAllDataManagers |
Passed | Passed | Passed | None |
7. Registering Individual Data Manager with Broker
COSMOS> broker register AperiMdr |
Passed | Passed | Passed | None |
7a. Registering Individual Data Manager with Broker
COSMOS> broker register SMLMDR |
Passed | Passed | Passed | None |
7b. Registering Individual Data Manager with Broker
COSMOS> broker register ExampleMdr |
Passed | Passed | Passed | None |
7c. Registering Individual Data Manager with Broker
COSMOS> broker register TestFederatingCMDB |
Passed | Passed | Passed | None |
7d. Registering Individual Data Manager with Broker
COSMOS> broker register LoggingDataManager |
Passed | Passed | Passed | None |
7e. Registering Individual Data Manager with Broker
COSMOS> broker register StatDataManager |
Passed | Passed | Passed | None |
8. Registering ServiceGroup
COSMOS> broker registerServiceGroup host1 AperiMdr http://localhost:8080/axis2/services/AperiMdrDataManager?wsdl http://localhost:8080/axis2/services/AperiMdrQueryService?wsdl |
Passed | Passed | Passed | None |
8a. Registering ServiceGroup
COSMOS> broker registerServiceGroup host1 SMLMDR http://localhost:8080/axis2/services/SmlMdrDataManager?wsdl http://localhost:8080/axis2/services/SmlMdrQueryService?wsdl |
Passed | Passed | Passed | None |
8b. Registering ServiceGroup
COSMOS> broker registerServiceGroup host1 ExampleMdr http://localhost:8080/axis2/services/ExampleMdrDataManager?wsdl http://localhost:8080/axis2/services/ExampleMdrQueryService?wsdl |
Passed | Passed | Passed | None |
8c. Registering ServiceGroup
COSMOS> broker registerServiceGroup host1 LoggingDataManager http://localhost:8080/axis2/services/LoggingDataManager?wsdl http://localhost:8080/axis2/services/CBEServices?wsdl |
Passed | Passed | Passed | None |
8d. Registering ServiceGroup
COSMOS> broker registerServiceGroup host1 StatDataManager http://localhost:8080/axis2/services/StatisticalDataManager?wsdl http://localhost:8080/axis2/services/StatDataManager?wsdl |
Passed | Passed | Passed | None |
8e. Registering ServiceGroup
COSMOS> broker registerServiceGroup host1 TestFederatingCMDB http://localhost:8080/axis2/services/TestFederatingCMDBDataManager?wsdl http://localhost:8080/axis2/services/TestFederatingCMDBRegistrationService?wsdl http://localhost:8080/axis2/services/TestFederatingCMDBQueryService?wsdl |
Passed | Passed | Passed | None |
9. Print Broker EPR
COSMOS> broker epr print |
Passed | Passed | Passed | None |
10. Modifiying Broker EPR
COSMOS> broker epr change http://HOST2:PORT2/axis2/services/Broker |
Passed | Passed | Passed | None |
11. List All Data Managers Registered with Broker
COSMOS> broker getDataManagers |
Passed | Passed | Passed | None |
12. Find all DataManagers using CosmosServiceFinder web service
COSMOS> finddatamanagers http://localhost:8080/axis2/services/CosmosServiceFinder |
Passed | Passed | Passed | None |
13. Deregistering Data Managers from broker
COSMOS> broker deregister host1 StatDataManager |
Passed | Passed | Passed | None |
13a. COSMOS> broker deregister host1 LoggingDataManager | Passed | Passed | Passed | None |
13b. COSMOS> broker deregister host1 TestFederatingCMDB | Passed | Passed | Passed | None |
13c. COSMOS> broker deregister host1 ExampleMdr | Passed | Passed | Passed | None |
13d. COSMOS> broker deregister host1 SMLMDR | Passed | Passed | Passed | None |
13e. COSMOS> broker deregister host1 AperiMdr | Passed | Passed | Passed | None |
14. Executing CMDBf Queries using the command line client
COSMOS> graphQuery host1 SMLMDR C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt |
Passed | Passed | Passed | Empty Response |
14a. COSMOS> graphQuery host1 SMLMDR C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testPropertyQuery.txt | Passed | Passed | Passed | Empty Response |
15. COSMOS> graphQuery host1 ExampleMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt | Passed | Passed | Passed | None |
15a. COSMOS> graphQuery host1 ExampleMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-teachers.txt | Passed | Passed | Passed | None |
15b. COSMOS> graphQuery host1 ExampleMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\relationship-all-classes.txt | Passed | Passed | Passed | None |
15c. COSMOS> graphQuery host1 ExampleMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\teaches-relationship.txt | Passed | Passed | Passed | None |
16. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_all.xml | Passed | Passed | Passed | None |
16a. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_all_items.xml | Passed | Passed | Passed | None |
16b. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_disk.xml | Passed | Passed | Passed | None |
16c. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_hostport.xml | Passed | Passed | Passed | None |
16e. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_inst_system.xml | Passed | Passed | Passed | None |
16f. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_pool.xml | Passed | Passed | Passed | None |
16g. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_pool_volume_all.xml | Passed | Passed | Passed | None |
16h. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_pool_volume_constr.xml | Passed | Passed | Passed | None |
16i. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_disk_all.xml | Passed | Passed | Passed | None |
16j. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_disk_constr.xml | Passed | Passed | Passed | None |
16k. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_hostport_all.xml | Passed | Passed | Passed | None |
16l. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_hostport_constr.xml | Passed | Passed | Passed | None |
16m. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pool_prop.xml | Passed | Passed | Passed | None |
16n. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pools_all.xml | Passed | Passed | Passed | None |
16o. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pools_constr.xml | Passed | Passed | Passed | None |
16p. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_volume_all.xml | Passed | Passed | Passed | None |
16q. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_volume_constr.xml | Passed | Passed | Passed | None |
16r. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system.xml | Passed | Passed | Passed | None |
16s. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_constr.xml | Passed | Passed | Passed | None |
16t. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_inst_prop.xml | Passed | Passed | Passed | None |
16u. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_like.xml | Passed | Passed | Passed | None |
16v. COSMOS> graphQuery host1 AperiMdr C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_volume.xml | Passed | Passed | Passed | None |
16w. COSMOS> COSMOS> graphQuery host1 TestFederatingCMDB C:\cosmos\i11\cosmos-demo\cosmos-client\cmdbfQuery\TestFederatingCMDB\all_items.txt | Passed | Passed | Passed | None. |
COSMOS Web User Interface
Test Description | Test Status
Windows XP SP2 |
Test Status
Windows 2003 SP1 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|---|
1.Layout of the User Interface | Passed | Passed | Passed | All 3 panes - DataManagers,Details and Properties are visible properly |
2.Data Managers View | Passed | Passed | Passed | Found All 6 DataManagers under COSMOS Web UI |
3.StatDataManager
server 33 tomcat1181829221515 CBE -> Statistical Report |
Passed | Passed | Passed | Statistical Report generated successfully |
3a.StatDataManager
StatDataManager -> Properties... |
Passed | Passed | Passed | Able to set security properties information |
4.LoggingDataManager
access_log.cbe.xml -> Top 10 Log Report |
Passed | Passed | Passed | Top 10 Log Report generated successfully |
4a.LoggingDataManager
windows_app_log.cbe.xml -> Top 10 Log Report |
Passed | Passed | Passed | Top 10 Log Report generated successfully |
4b.LoggingDataManager
LoggingDataManager -> Properties... |
Passed | Passed | Passed | Able to set security information properly |
5.Resource Repository (SML MDR)
Resoure Repository->All Computer Systems |
Passed | Passed | Passed | Pre-defined CMDBf query for All Computer systems, executed successfully |
5a.Resource Repository (SML MDR)
Resoure Repository->All Operating Systems |
Passed | Passed | Passed | Pre-defined CMDBf query for All Operating systems, executed successfully |
5b.Resource Repository (SML MDR)
Resoure Repository->Operating System of Computer |
Passed | Passed | Passed | Pre-defined CMDBf query for 'Operating System of Computer', executed successfully |
5c.Resource Repository (SML MDR)
Resoure Repository->New Folder... |
Passed | Passed | Passed | Able to create new folder |
5d.Resource Repository (SML MDR)
Resoure Repository->Submit Query... |
Passed | Passed | Passed | Able to execute CMDBf queries (Works same as Submit Query as Text) |
5e.Resource Repository (SML MDR)
Resoure Repository->Submit Query as Text |
Passed | Passed | Passed | Able to execute CMDBf queries successfully |
5f.Resource Repository (SML MDR)
Resoure Repository->View MetaData |
Passed | Passed | Passed | Able to see appropriate metadata information - No Metadata available |
5g.Resource Repository (SML MDR)
Resource Repository->Properties |
Passed | Passed | Passed | Able to set security properties properly |
5h.Resource Repository (SML MDR)
Resource Repository->New Folder->New Folder... |
Passed | Passed | Passed | Able to create subfolder under existing folder |
5i.Resource Repository (SML MDR)
Resource Repository->CMDBf Query..->Open With>>->Tabular View |
Passed | Passed | Passed | Able to see CMDBf response data as Tabular view |
5j.Resource Repository (SML MDR)
Resource Repository->CMDBf Query..->Open With>>->Hierarchal View |
Passed | Passed | Passed | Able to view Hierarchial view of CMDBf data |
5k.Resource Repository (SML MDR)
Resource Repository->CMDBf Query..->Register Configuration Items... |
Passed | Passed | Passed | Partial registration works fine |
5l.Resource Repository (SML MDR)
Resource Repository->CMDBf Query..->DeRegister Configuration Items... |
Passed | Passed | Passed | Partial deregistration works fine |
5m.Resource Repository (SML MDR)
Resource Repository->CMDBf Query..->Rename... |
Passed | Passed | Passed | Renaming Query or folder name works fine |
5n.Resource Repository (SML MDR)
Resource Repository->New Folder->CMDBf Query..->Rename... |
Passed | Passed | Passed | Renaming Query or folder under subfolder is working fine |
5o.Resource Repository (SML MDR)
Resource Repository->CMDBf Query..->Refresh |
Passed | Passed | Passed | Refresh works fine |
5p.Resource Repository (SML MDR)
Resource Repository->CMDBf Query..->Response History... |
Passed | Passed | Passed | Response History works fine with history data |
6.Sample Repository with Query (EXAMPLE MDR)
Get All Students |
Passed | Passed | Passed | Displayed Query Result for Students data correctly |
6a.Sample Repository with Query (EXAMPLE MDR)
Get All Teachers |
Passed | Passed | Passed | Displayed Query Result for Teachers data correctly |
6b.Sample Repository with Query (EXAMPLE MDR)
Get All Classes |
Passed | Passed | Passed | Displayed Query Result for Classes data correctly |
6c.Sample Repository with Query (EXAMPLE MDR)
Staff01 |
Passed | Passed | Passed | Displayed data for 'students taught by teacher-staff01' correctly |
6d.Sample Repository with Query (EXAMPLE MDR)
Staff02 |
Passed | Passed | Passed | Displayed data for 'students taught by teacher-staff02' correctly |
6e.Sample Repository with Query (EXAMPLE MDR)
Submit Query |
Passed | Passed | Passed | Using Query Builder, able to create and execute queries correctly |
6f.Sample Repository with Query (EXAMPLE MDR)
Submit Query as Text |
Passed | Passed | Passed | Able to execute CMDBf queries successfully |
6g.Sample Repository with Query (EXAMPLE MDR)
View MetaData |
Passed | Passed | Passed | Displayed MetaData information correctly |
6h.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->Properties |
Passed | Passed | Passed | Able to set Security information correctly |
6i.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->New Folder... |
Passed | Passed | Passed | Able to create New Folder correctly |
6j.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->New Folder->New Folder... |
Passed | Passed | Passed | Able to create Sub Folder under existing folder correctly |
6k.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->CMDBf Query..->Open With>>->Tabular View |
Passed | Passed | Passed | Able to see tabular view of CMDBf query result data correctly, Having some problem with IE |
6l.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->CMDBf Query..->Open With>>->Hierarchal View |
Passed | Passed | Passed | Able to see Hierarchial view of CMDBf query result data correctly |
6m.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->CMDBf Query..->Register Configuration Items... |
Passed | Passed | Passed | Able to do partial registration correctly |
6n.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->CMDBf Query..->DeRegister Configuration Items... |
Passed | Passed | Passed | Able to do partial deregistration correctly |
6o.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->CMDBf Query..->Rename... |
Passed | Passed | Passed | Able to Rename Query or folder name correctly |
6p.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->New Folder->CMDBf Query...->Rename... |
Passed | Passed | Passed | Able to Rename Query or folder under existing folder |
6q.Sample Repository with Query (EXAMPLE MDR)
Sample Reposotiry with Query->CMDBf Query..->Refresh |
Passed | Passed | Passed | CMDBf Query refresh works fine |
6r.Sample Repository with Query (EXAMPLE MDR)
Sample Reposotiry with Query->CMDBf Query..->Response History... |
Passed | Passed | Passed | Response history works fine with history data |
7.Sample Repository with Registration (Federating CMDB)
All Items and Relationships |
Passed | Passed | Passed | Pre-defined Query - All Items and Relationships executed successfully |
7a.Sample Repository with Registration (Federating CMDB)
Submit Query |
Passed | Passed | Passed | Able to run CMDBf queries successfully (same as Submit Query as Text) |
7b.Sample Repository with Registration (Federating CMDB)
Submit Query as Text |
Passed | Passed | Passed | Able to run CMDBf queries successfully (same as Submit Query as Text) |
7c.Sample Repository with Registration (Federating CMDB)
Register Configuration Items...->select "Sample Repository with Query" |
Passed | Passed | Passed | Full Registration with Example MDR is successful |
7d.Sample Repository with Registration (Federating CMDB)
Register Configuration Items...->select "Resource Repository" |
Passed | Passed | Passed | Full Registration with SML MDR is successful |
7e.Sample Repository with Registration (Federating CMDB)
Register Configuration Items...->select "Storage Repository" |
Failed | Failed | Failed | Full Registration with AperiMdr - Failed (No response on UI) |
7f.Sample Repository with Registration (Federating CMDB)
Deregister Configuration Items...->select "Sample Repository with Query" |
Passed | Passed | Passed | Full Deregistration with Example MDR is successful |
7g.Sample Repository with Registration (Federating CMDB)
Deregister Configuration Items...->select "Resource Repository" |
Passed | Passed | Passed | Full Deregistration with SML MDR is successful |
7h.Sample Repository with Registration (Federating CMDB)
Deregister Configuration Items...->select "Storage Repository" |
Failed | Failed | Failed | Full Deregistration with Aperi MDR - Failed |
7i.Sample Repository with Registration (Federating CMDB)
register Configuration Items...->select "Sample Repository with Query" and "Resource Repository" |
Passed | Passed | Passed | Full registration with Example Mdr and SML Mdr - Passed |
7j.Sample Repository with Registration (Federating CMDB)
Deregister Configuration Items...->select "Sample Repository with Query" and "Resource Repository" |
Passed | Passed | Passed | Full deregistration with Example Mdr and SML Mdr - Passed |
7k.Sample Repository with Registration (Federating CMDB)
New Folder... |
Passed | Passed | Passed | Able to create New Folder successfully |
7l.Sample Repository with Registration (Federating CMDB)
CMDBf Query..->Rename... |
Passed | Passed | Passed | Able to rename Query/Folder successfully |
7m.Sample Repository with Registration (Federating CMDB)
Properties... |
Passed | Passed | Passed | Able to set Security Information correctly |
7n.Sample Repository with Registration (Federating CMDB)
CMDBf Query..->Open With>>->Tabular View |
Passed | Passed | Passed | Able to view CMDBf query result under Tabular view properly (IE is having some problem) |
7o.Sample Repository with Registration (Federating CMDB)
CMDBf Query..->Open With>>->Hierarchial View |
Passed | Passed | Passed | Hierarchial View of CMDBf result data working properly |
7p.Sample Repository with Registration (Federating CMDB)
CMDBf Query..->Refresh |
Passed | Passed | Passed | CMDBf Query refresh is working fine |
7q.Sample Repository with Registration (Federating CMDB)
View MetaData |
Passed | Passed | Passed | Able to view appropriate message for View MetaData |
7r.Sample Repository with Registration (Federating CMDB)
Response History... |
Passed | Passed | Passed | Able to view Response Histories with last queried data |
8a.AperiMDR (Storage Repository)
New Folder... |
Passed | Passed | Passed | None |
8b.AperiMDR (Storage Repository)
Submit Query |
Passed | Passed | Passed | Using Query builder able to execute and validate queries properly |
8c.AperiMDR (Storage Repository)
Submit Query as Text |
Passed | Passed | Passed | Able to execute CMDBf queries correctly |
8d.AperiMDR (Storage Repository)
View MetaData |
Passed | Passed | Passed | Displayed MetaData properly |
8e.AperiMDR (Storage Repository)
Properties... |
Passed | Passed | Passed | Able to set security properties properly |
8f.AperiMDR (Storage Repository)
CMDBf Query->Open With >>->Tabular View |
Passed | Passed | Passed | Able to view Tabular View of CMDBf query response data |
8g.AperiMDR (Storage Repository)
CMDBf Query->Open With >>->Hierarchial View |
Passed | Passed | Passed | Able to view Hierarchial View of CMDBf query response data |
8h.AperiMDR (Storage Repository)
CMDBf Query->Register Configuration Items... |
Passed | Passed | Passed | Partial registration with FederatingCMDB works fine |
8i.AperiMDR (Storage Repository)
CMDBf Query->DeRegister Configuration Items... |
Passed | Passed | Passed | Partial Deregistration with FederatingCMDB works fine |
8k.AperiMDR (Storage Repository)
CMDBf Query->Rename... |
Passed | Passed | Passed | Renaming Query or folder names works fine |
8l.AperiMDR (Storage Repository)
New Folder->CMDBf Query->Rename... |
Passed | Passed | Passed | Renaming Query or folder names under subfolder - Works fine |
8m.AperiMDR (Storage Repository)
CMDBf Query->Refresh |
Passed | Passed | Passed | CMDBf query refresh work fine |
8n.AperiMDR (Storage Repository)
CMDBf Query->Response History... |
Passed | Passed | Passed | Response History is working fine |
2. i11 ERs – JUnits/Manual Tests inspection
- Iteration_11_Enhancements
- QA has verified only following ER's as most of the others are documentation/build related.
Bugzilla ID | ID Summary | JUnits Tests | Manual Tests | Remarks |
---|---|---|---|---|
https://bugs.eclipse.org/bugs/show_bug.cgi?id=223271 | Need ability to rename saved queries | NA | Available | Found test cases as part of DataVisualization.UI.Component.Widget.testsuite
and test execution passed. |
https://bugs.eclipse.org/bugs/show_bug.cgi?id=231400 | Design & implement simple MDR authentication (login / password) for COSMOS 1.0 | NA | Available | Found some test cases as part of DataVisualization.UI.Component.Widget.testsuite in setting up security information and test execution passed. |
https://bugs.eclipse.org/bugs/show_bug.cgi?id=223270 | Need ability to manage queries | NA | Available | Found TPTP Manual tests defined under /org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Component.Widget.testsuite for managing queries |
https://bugs.eclipse.org/bugs/show_bug.cgi?id=222504 | UI cannot show the query request | NA | Available | Found TPTP Manual tests defined under
/org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Component.Widget.testsuite, for viewing CMDBf query document |
https://bugs.eclipse.org/bugs/show_bug.cgi?id=224166 | Improve the Graph Response Viewer View | NA | NA | No explicit tests provided, however this has been covered as part of End2End tests defined at http://wiki.eclipse.org/COSMOS_DEMO_i11 |
https://bugs.eclipse.org/bugs/show_bug.cgi?id=224172 | Improve registration/deregistration response dialog box | NA | NA | No explicit tests provided, however this has been covered as part of End2End tests defined at http://wiki.eclipse.org/COSMOS_DEMO_i11 |
https://bugs.eclipse.org/bugs/show_bug.cgi?id=224173 | Dialog Box: Press escape should close dialog box | NA | NA | No explicit tests provided, however this has been tested as part of End2End
testing based on http://wiki.eclipse.org/COSMOS_DEMO_i11 |
https://bugs.eclipse.org/bugs/show_bug.cgi?id=228268 | Dialog Box: Press escape should close dialog box | NA | NA | No explicit tests provided, however this has been tested as part of End2End
testing based on http://wiki.eclipse.org/COSMOS_DEMO_i11 |
https://bugs.eclipse.org/bugs/show_bug.cgi?id=234373 | Provide security capabilites in the UI | NA | Available | Found TPTP Manual tests defined under
/org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Component.Widget.testsuite,for setting Security information. |
3. Data Visualization TPTP Manual Tests Execution
DataVisualization.UI.Component.Widget.testsuite
/org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Component.Widget.testsuite
Test Description | Test Status
Windows XP SP2 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|
1.navigate | Passed | Passed | In i11, StatDataManager node contains only 1 child node |
2.navigate2 | Passed | Passed | Given query returns empty Response, however there are some pre-defined queries, where we can see query results |
3.properties | Passed | Passed | Property pane reveils appropriate information correctly |
4.visualize log report | Passed | Passed | Top 10 Log Report generated successfully without any errors |
5.visualize stat report | Passed | Passed | Statistical Report generated successfully |
6.properties 2 | Passed | Passed | Properties for all Data Managers have been verified and found to be correct |
7.Multiple Graph Response Viewers | Failed | Failed | java.util.MissingResourceException: Can't find bundle for base name org.eclipse.cosmos.internal.dr.drs.service.outputter.messages, locale en_AU. |
8.Registration Example | Passed | Passed | Full registration of ExampleMDR with FederatingCMDB is successful |
9.DeRegistration Example | Passed | Passed | Full deregistration of ExampleMDR with FederatingCMDB is successful |
10.Partial Registration of MDR with CMDBf | Passed | Passed | Partial registration of SMLMDR - predefined query data with FederatingCMDB is successful |
11.Partial DeRegistration of MDR with CMDBf | Passed | Passed | Partial deregistration of SMLMDR - predefined query data with FederatingCMDB is successful |
12.Creating Named Query | Passed | Passed | Creation of Named Query and execution successful |
13.Rename a Query | Passed | Passed | Renaming a Query works fine |
14.Creating a Query Folder | Passed | Passed | Able to create New Folder successfully |
15.Rename a folder | Passed | Passed | Renaming folder works fine |
16.Enter Security Info | Passed | Passed | Able to enter security information and executed CMDBf queries successfully |
17.Save Queries | Passed | Passed | Able to save queries and response histories |
18.Using Submit Query as Text | Passed | Passed | "Submit Query as Text" works fine. |
19.Query Properties | Passed | Passed | "Get All Students" - Query properties displayed different data |
DataVisualization.UI.Reports.testsuite
/org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Reports.testsuite
Test Description | Test Status
Windows XP SP2 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|
1.LogReport | Passed | Passed | LogReport generated successfully |
2.StatReport | Passed | Passed | StatReport generated successfully |
4. Execution of i11 supplement e2e tests (negative) from QA.
Build Installation and Configuration
Test Description | Test Status
Windows XP SP2 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|
1.Installing COSMOS Web applications and Web Services - tomcatDir with spaces running on port 8090
<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <dojo-path> <axis2war-path> |
Passed | Passed | On Linux,configDemo.sh requires quotes over command line argument variables |
COSMOS Command Line Client
Test Description | Test Status
Windows XP SP2 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|
1. Register All Data Managers with Broker (running on port 8090)
COSMOS> broker registerAllDataManagers |
Passed | Passed | None |
1a. Register All Data Managers with Broker (re-doing registration again)
|
Passed | Passed | SOAP response displays appropriate message as 'REGISTRATION_DUPLICATE_SERVICE', however COSMOS Command line client displays inappropriate messages. |
1b. Register All Data Managers with Broker (with invalid Broker EPR)
|
Passed | Passed | Displays appropriate message as 'AxisFault: check the EPR being used' |
2. Registering Individual Data Manager with Broker (running on port 8090)
COSMOS> broker register AperiMdr |
Passed | Passed | Registered successfully and displayed message as 'Registering AperiMdr' |
2a. Registering Individual Data Manager with Broker (registring multiple times)
COSMOS> broker register AperiMdr |
Passed | Passed | SOAP response displays appropriate message, however COSMOS Command line client displays inappropriate message 'Registering AperiMdr' |
2b. Registering Individual Data Manager with Broker (with invalid Broker EPR)
|
Passed | Passed | AxisFault: check the EPR being used. |
2c. Registering Individual Data Manager with Broker (with Invalid DataManager Name)
COSMOS> broker register MyAperiMdr |
Passed | Passed | Displays message as 'Not Found!' |
3. Registering ServiceGroup (registring Multiple times)
|
Passed | Passed | SOAP response displays appropriate message, but COSMOS CLI displays inappropriate message. |
3a. Registering ServiceGroup (with Incorrect Host Name)
COSMOS> broker registerServiceGroup myhost AperiMdr http://localhost:8090/axis2/services/AperiMdrDataManager?wsdl http://localhost:8090/axis2/services/AperiMdrQueryService?wsdl |
Passed | Passed | Registered group successfully with hostname as 'myhost'. Is this correct behaviour ? |
3b. Registering ServiceGroup (with Incorrect DataManager Name)
COSMOS> broker registerServiceGroup host1 MySMLMDR http://localhost:8090/axis2/services/SmlMdrDataManager?wsdl http://localhost:8090/axis2/services/SmlMdrQueryService?wsdl |
Passed | Passed | Registered group successfully with Group Name as 'MySMLMDR' |
3c. Registering ServiceGroup (with invalid/non-existing WSDL files)
COSMOS> broker registerServiceGroup host1 ExampleMdr http://localhost:8090/axis2/services/MyExampleMdrDataManager?wsdl http://localhost:8090/axis2/services/MyExampleMdrQueryService?wsdl |
Failed | Failed | Found some exceptions - "Could not get WSDL!; Command error: null java.lang.NullPointerException" |
3d. Registering ServiceGroup (with invalid Broker EPR)
COSMOS> broker registerServiceGroup host1 ExampleMdr http://localhost:8090/axis2/services/ExampleMdrDataManager?wsdl http://localhost:8090/axis2/services/ExampleMdrQueryService?wsdl |
Passed | Passed | Registration failed with Command error: The service cannot be found for the endpoint reference (EPR) http://domsr01-xp:8090/axis2/services/MBroker |
4. List All Data Managers Registered with Broker (With no registration)
COSMOS> broker getDataManagers |
Passed | Passed | Display empty response with message 'Data managers registered at the broker:' |
4a. List All Data Managers Registered with Broker (With invalid broker EPR)
COSMOS> broker getDataManagers |
Passed | Passed | Displays error as "org.eclipse.cosmos.dc.broker.provisional.client.BrokerException: The service cannot be found for the endpoint reference (EPR) http://domsr01-xp:8090/axis2/service/MBroker" |
5. Find all DataManagers using CosmosServiceFinder web service (Invalid CosmosServiceFinder EPR)
COSMOS> finddatamanagers http://localhost:8080/axis2/services/myCosmosServiceFinder |
Passed | Passed | Displays appropriate message as 'AxisFault: check the EPR being used.' |
5a. Find all DataManagers using CosmosServiceFinder web service (with no DataManagers deployed)
COSMOS> finddatamanagers http://localhost:8080/axis2/services/CosmosServiceFinder |
Passed | Passed | None |
6. Deregistering Data Managers from broker (with Port 8090)
COSMOS> broker deregister host1 StatDataManager |
Passed | Passed | Deregistered successfully |
6a. Deregistering Data Managers from broker (with invalid hostname)
COSMOS> broker deregister host1 LoggingDataManager |
Passed | Passed | SOAP response display appropriate message, however COSMOS CLI display inappropriate message as 'Deregistered successfully' |
6b. Deregistering Data Managers from broker (with invalid DataManager Name)
COSMOS> broker deregister host1 TestFederatingCMDB |
Passed | Passed | SOAP response display appropriate message, however COSMOS CLI display inappropriate message as 'Deregistered successfully' |
6c. Deregistering Data Managers from broker (deregistring multiple times)
|
Passed | Passed | SOAP response display appropriate message, however COSMOS CLI display inappropriate message as 'Deregistered successfully' |
7. Executing CMDBf Queries using the command line client (Query Path with spaces)
COSMOS> graphQuery localhost ExampleMdr C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt |
Passed | Passed | Displays error as "java.io.FileNotFoundException: C:\Program (The system cannot find the file specified)" |
7a. Executing CMDBf Queries using the command line client (Query Path with quotes)
COSMOS> graphQuery localhost ExampleMdr "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt" |
Passed | Passed | Executed Query successfully |
7b. Executing CMDBf Queries using the command line client (Incorrect path)
COSMOS> graphQuery host1 ExampleMdr "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\MyExampleMDR\all-students.txt" |
Passed | Passed | Display error as "java.io.FileNotFoundException" |
7c. Executing CMDBf Queries using the command line client (Wrong Query)
COSMOS> graphQuery localhost SMLMDR "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt" |
Passed | Passed | Empty Response |
7d. Executing CMDBf Queries using the command line client (Invalid host)
COSMOS> graphQuery myhost ExampleMdr "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt" |
Passed | Passed | Display error as "org.eclipse.cosmos.dc.broker.provisional.client.BrokerException: unknown" |
7e. Executing CMDBf Queries using the command line client (Invalid DataManager)
COSMOS> graphQuery localhost MyExampleMdr "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt" |
Passed | Passed | Displayed error as "org.eclipse.cosmos.dc.broker.provisional.client.BrokerException: unknown" |
7f. Executing CMDBf Queries using the command line client (with Inactive DataManager)
|
Passed | Passed | Displayed error as "org.eclipse.cosmos.dc.broker.provisional.client.BrokerException: unknown" |
7g. Executing CMDBf Queries using the command line client (with no Aperi DB startup)
COSMOS> graphQuery host1 AperiMdr "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_pool.xml" |
Passed | Passed | Displayed error as "Aperi Exception: java.net.ConnectException : Error connecting to server localhost on port 1527 with message Connection refused: connect." |
8 Broker epr change test scenario
|
Passed | Passed | All DataManagers registered with second broker displayed correctly |
COSMOS Web User Interface
Test Description | Test Status
Windows XP SP2 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|
1.Layout of the User Interface (with port 8090)
|
Passed | Passed | All 3 panes - DataManagers,Details and Properties are visible properly and all 6 DataManagers are displayed correctly |
2.Resource Repository (SML MDR)(with Invalid FolderName)
Resoure Repository->New Folder... |
Passed | Passed | Able to create new folder with any kind of name |
2a.Resource Repository (SML MDR)(with existing FolderName)
Resoure Repository->New Folder... |
Passed | Passed | Able to create duplicate folder/query name |
2b.Resource Repository (SML MDR) (with invalid Query data)
Resoure Repository->Submit Query... |
Passed | Passed | Query execution failed, and displays appropriate error |
2c.Resource Repository (SML MDR) (Invalid filename with spaces)
Resource Repository->CMDBf Query..->Rename... |
Passed | Passed | Renaming Query or folder name with any junk values works |
3.Sample Repository with Query (EXAMPLE MDR) (Invalid Query data)
Submit Query |
Passed | Passed | Using Query Builder, able to create and execute invalid/incomplete query and on execution found an appropriate error message |
3a.Sample Repository with Query (EXAMPLE MDR) (invalid query data)
Submit Query as Text |
Passed | Passed | Able to execute invalid CMDBf query and found an appropriate error message |
4.Sample Repository with Registration (Federating CMDB) (Multiple Selections of DM)
Register Configuration Items...->select all 3 Data Managers |
Passed | Passed | Full Registration with AperiMDR is not working, other combinations of DM's are working fine |
4a.Sample Repository with Registration (Federating CMDB)(Multiple Selection)
DeRegister Configuration Items...->select all 3 Data Managers |
Passed | Passed | Full DeRegistration with AperiMDR is not working, other combinations of DM's are working fine |
4b.AperiMDR (Storage Repository) (with no Aperi DB setup)
Submit Query |
Passed | Passed | Using Query builder able to create and execute queries. Upon execution, query resulted in error with appropriate Database connectivity message. |
4c.AperiMDR (Storage Repository) (Invalid Query Data)
Submit Query as Text |
Passed | Passed | Able to execute invalid CMDBf query and upon execution found appropriate error message |
5. Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)
ManagementEnablement.UI.dmtoolkit.testsuite
/org.eclipse.cosmos.me.dmtoolkit.tests/manual/ManagementEnablement.UI.dmtoolkit.testsuite
Test Description | Test Status
Windows XP SP2 |
Remarks |
---|---|---|
1.Creating a Data Manager Project | Passed | Data Manager Project Creation wizard, executed successfully |
2.Facet Interface for creating DM Project | Passed | Facet Interface for creating DM Project, executed successfully |
SML Tooling tests (UI Validation)
- SML editor/import/export UI validation tests
- SML tooling instructions available at http://wiki.eclipse.org/COSMOS_UG_SML
- SML test resources are located under CVS at org.eclipse.cosmos.rm.validation.tests/src/test-resources/
Test Description | Test Status
Windows XP SP2 |
Remarks |
---|---|---|
1.Using SML-IF editor,validating SMLIF document
|
Passed | Dispalying appropriate markers and line numbers for any errors during validation |
2.Creating SML-IF document
|
Passed | Validation failed with Error - "cvc-complex-type.2.4.a: Invalid content was found starting with element 'smlif:description'. One of '{WC[##other:"http://www.w3.org/2008/03/sml-if"]}' is expected. Line:12 Column:22" |
3.Using SML-IF editor,Overview tab
|
Passed | Overview tab changes are visible under source file |
4.importing a SML-IF file
|
Passed | Able to import SML-IF file successfully |
5.importing a SML-IF file, Validating the resulting folder
|
Passed | Able to import SML-IF file successfully. |
6.importing a SML-IF file, exporting the resulting folder
|
Passed | Able to import and export SML-IF file successfully |
7.Exporting a SML-IF file, with new rule bindings
|
Failed | Able to export the file but unable to add new rule bindings |
6. Basic operational efficiency tests (limited performance tests)
Configuration Tests
Test Description | Test Status | Remarks |
---|---|---|
1.Testing the scenario where COSMOSUI,COSMOSReportViewer running on windows PC1,broker running on windows PC2 and all datamanagers running on linux PC1
<cosmos-demo>/cosmosClient/bin/cosmosClient.bat http://<WindowsPC2host>:8080/axis2/services/Broker COMSOS>broker registerAllDataManagers http://<linuxPC1host:8080>/axis2/services/CosmosServiceFinder
|
Passed | COSMOS UI works fine with this setup. |
2.Testing the scenario where COSMOSUI running on windows and all COSMOS services running on Linux
|
Passed | COSMOS UI works fine with this setup. |
Concurrency Tests
Test Description | Test Status | Remarks |
---|---|---|
1.Concurrency tests, where multiple COSMOSUI's running on one machine
|
Passed | None |
2.Concurrency tests, where multiple COSMOSUI's and multiple COSMOS Command Line Clients running on one machine
|
Passed | None |
Volume/Performance Tests
- Refer http://wiki.eclipse.org/COSMOS_Performance_Testing#Performance_Tests
- Refer http://wiki.eclipse.org/COSMOS_Performance_Testing#Scalability_Tests