Skip to main content

Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

COSMOS i14 QA Phase Execution

Revision as of 04:42, 11 November 2008 by SrinivasReddy.Doma.ca.com (Talk | contribs) (→‎QA i14 Test Execution Summary)

QA Test Execution Activities for i14

Planned QA Activities for i14

1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0

2. Data Visualization TPTP Manual Tests Execution

  • DataVisualization.UI.Component.Widget.testsuite / UI.Reports.testsuite

3. Execution of i14 supplement e2e tests (negative) from QA.

4. Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)

  • org.eclipse.cosmos.me.dmtoolkit.tests/ManagementEnablement.UI.dmtoolkit.testsuite
  • SML Tooling UI tests - TestNewSMLIF/TestSMLIFValidator/TestImportOperation/TestExportOperation

5. Basic operational efficiency tests (limited performance tests)

For complete i14 QA Activities, refer http://wiki.eclipse.org/COSMOS_QA_i14_Activities

QA i14 Test Execution Summary

COSMOS-1.0.0-200811041640 : QA Status (--SrinivasReddy.Doma.ca.com 08:42, 11 November 2008 (UTC))

  • QA has finished following i14 test execution activities on the latest dev build - COSMOS-1.0.0-200811041640, without any blocking issues.
    • E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0 (http://wiki.eclipse.org/COSMOS_DEMO_i14) - Completed
    • Data Visualization TPTP Manual Tests Execution (DataVisualization.UI.Component.Widget.testsuite / UI.Reports.testsuite) - Completed
    • MDR Toolkit - TPTP Manual tests (ManagementEnablement.UI.dmtoolkit.testsuite) - Completed
    • Execution of i14 supplement e2e tests(negative) from QA. - Completed
    • SML Tooling - TPTP Manual tests (TestNewSMLIF/TestSMLIFValidator/TestImportOperation/ TestExportOperation) - Completed
    • Limited Performance Testings - Completed.

Issues/Observations:

QA i14 Execution - Complete Status

E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0

Build Installation and Configuration

Test Description Test Status 
 Windows XP SP2
Test Status 
 Windows 2003 SP1
Test Status 
 RHES 5.0
Remarks
1.Download COSMOS Demo and Prerequisites Passed Passed Passed None
2.Installing COSMOS Web applications and Web Services

<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <axis2war-path>

Passed Passed Passed None
3.Installing COSMOS SDK Passed Passed Passed None
4.Installing Resource Modeling Tooling Passed Passed Passed None

COSMOS Command Line Client

Test Description Test Status 
 Windows XP SP2
Test Status 
 Windows 2003 SP1
Test Status 
 RHES 5.0
Remarks
1. Start the COSMOS Command Line Client

<cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:8080/axis2/services/Broker

Passed Passed Passed None
2. Security Header - Set SoapVersion

COSMOS> Setsoapversion 1.2

Passed Passed Passed None
3. Security Header - Set username/password

COSMOS> Setcredentials test test123

Passed Passed Passed None
4. Security Header - Show Details

COSMOS> Settings

Passed Passed Passed None
5. Register All Data Managers with Broker

COSMOS> RegisterAllDataManagers

Passed Passed Passed None
6. Registering Individual Data Manager with Broker - AperiMdr

COSMOS> Register http://www.eclipse.org/cosmos/aperimdr/6

Passed Passed Passed Storage Repository Registered
6a. Registering Individual Data Manager with Broker - SMLMDR

COSMOS> Register http://www.eclipse.org/cosmos/smlmdr/5

Passed Passed Passed None
6b. Registering Individual Data Manager with Broker - ExampleMdr

COSMOS> Register http://www.eclipse.org/cosmos/examplemdr/4

Passed Passed Passed None
6c. Registering Individual Data Manager with Broker - TestFederatingCMDB

COSMOS> Register http://www.eclipse.org/cosmos/TestFedCMDB/3

Passed Passed Passed None
6d. Registering Individual Data Manager with Broker - LoggingDataManager

COSMOS> Register http://www.eclipse.org/cosmos/logging/2

Passed Passed Passed None
6e. Registering Individual Data Manager with Broker - StatDataManager

COSMOS> Register http://www.eclipse.org/cosmos/stat/1

Passed Passed Passed None
7. Registering ServiceGroup

COSMOS> RegisterServiceGroup domsr01-xp "Storage Repository" http://www.eclipse.org/cosmos/aperimdr/6 http://www.w3.org/2003/05/soap-envelope http://www.eclipse.org/cosmos/aperimdr http://www.eclipse.org/cosmos/security/basic http://domsr01-xp:8080/axis2/services/AperiMdrQueryService?wsdl

Passed Passed Passed ServiceGroup registered successfully, displayed message as "Ok" - Needs more appropriate message?
8. Print Broker EPR

COSMOS> PrintBrokerEPR

Passed Passed Passed The current Broker EPR being used is http://localhost:8080/axis2/services/Broker
10. Modifiying Broker EPR

COSMOS> ChangeBrokerEPR http://localhost:8090/axis2/services/Broker

Passed Passed Passed None
11. List All Data Managers Registered with Broker

COSMOS> GetDataManagers

Passed Passed Passed None
12. Find all DataManagers using CosmosServiceFinder web service

COSMOS> FindDataManagers http://localhost:8080/axis2/services/CosmosServiceFinder

Passed Passed Passed None
13. Deregistering Data Managers from broker

COSMOS> Deregister http://www.eclipse.org/cosmos/stat/1

Passed Passed Passed None
13a. COSMOS> Deregister http://www.eclipse.org/cosmos/logging/2 Passed Passed Passed None
13b. COSMOS> Deregister http://www.eclipse.org/cosmos/TestFedCMDB/3 Passed Passed Passed None
13c. COSMOS> Deregister http://www.eclipse.org/cosmos/examplemdr/4 Passed Passed Passed None
13d. COSMOS> Deregister http://www.eclipse.org/cosmos/smlmdr/5 Passed Passed Passed None
13e. COSMOS> Deregister http://www.eclipse.org/cosmos/aperimdr/6 Passed Passed Passed None
14. Executing CMDBf Queries using the command line client

COSMOS> GraphQuery http://www.eclipse.org/cosmos/smlmdr/5 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt

Passed Passed Passed Empty Response
14a. COSMOS> GraphQuery http://www.eclipse.org/cosmos/smlmdr/5 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testPropertyQuery.txt Passed Passed Passed Empty Response
15. COSMOS> GraphQuery http://www.eclipse.org/cosmos/examplemdr/4 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt Passed Passed Passed Under linux, having problem with GraphQuery when we provide result filename to save query output.
15a. COSMOS> GraphQuery http://www.eclipse.org/cosmos/examplemdr/4 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-teachers.txt Passed Passed Passed None
15b. COSMOS> GraphQuery http://www.eclipse.org/cosmos/examplemdr/4 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\relationship-all-classes.txt Passed Passed Passed None
15c. COSMOS> GraphQuery http://www.eclipse.org/cosmos/examplemdr/4 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\teaches-relationship.txt Passed Passed Passed None
16. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_all.xml Passed Passed Passed None
16a. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_all_items.xml Passed Passed Passed None
16b. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_disk.xml Passed Passed Passed None
16c. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_hostport.xml Passed Passed Passed None
16e. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_inst_system.xml Passed Passed Passed None
16f. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_pool.xml Passed Passed Passed None
16g. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_pool_volume_all.xml Passed Passed Passed None
16h. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_pool_volume_constr.xml Passed Passed Passed None
16i. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_disk_all.xml Passed Passed Passed None
16j. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_disk_constr.xml Passed Passed Passed None
16k. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_hostport_all.xml Passed Passed Passed None
16l. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_hostport_constr.xml Passed Passed Passed None
16m. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pool_prop.xml Passed Passed Passed None
16n. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pools_all.xml Passed Passed Passed None
16o. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pools_constr.xml Passed Passed Passed None
16p. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_volume_all.xml Passed Passed Passed None
16q. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_volume_constr.xml Passed Passed Passed None
16r. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system.xml Passed Passed Passed None
16s. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_constr.xml Passed Passed Passed None
16t. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_inst_prop.xml Passed Passed Passed None
16u. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_like.xml Passed Passed Passed None
16v. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_volume.xml Passed Passed Passed None
16w. COSMOS> GraphQuery http://www.eclipse.org/cosmos/TestFedCMDB/3 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\TestFederatingCMDB\all_items.txt Passed Passed Passed None.
17. COSMOS> GetDataManagerById http://www.eclipse.org/cosmos/stat/1 Passed Passed Passed None.
17a. COSMOS> GetDataManagerById http://www.eclipse.org/cosmos/logging/2 Passed Passed Passed None.
17b. COSMOS> GetDataManagerById http://www.eclipse.org/cosmos/TestFedCMDB/3 Passed Passed Passed None.
17c. COSMOS> GetDataManagerById http://www.eclipse.org/cosmos/examplemdr/4 Passed Passed Passed None.
17d. COSMOS> GetDataManagerById http://www.eclipse.org/cosmos/smlmdr/5 Passed Passed Passed None.
17e. COSMOS> GetDataManagerById http://www.eclipse.org/cosmos/aperimdr/6 Passed Passed Passed None.
18. COSMOS> GetDataManagersByRecordTypeNamespace http://www.eclipse.org/cosmos/stat Passed Passed Passed None.
18a. COSMOS> GetDataManagersByRecordTypeNamespace http://www.eclipse.org/cosmos/testfedcmdb Passed Passed Passed None.
18b. COSMOS> GetDataManagersByRecordTypeNamespace http://schemas.serviceml.org/sml/2007/02 Passed Passed Passed None.
18c. COSMOS> GetDataManagersByRecordTypeNamespace http://www.eclipse.org/cosmos/logging Passed Passed Passed None.
18d. COSMOS> GetDataManagersByRecordTypeNamespace http://www.eclipse.org/cosmos/examplemdr Passed Passed Passed None.
18e. COSMOS> GetDataManagersByRecordTypeNamespace http://www.eclipse.org/cosmos/aperimdr Passed Passed Passed None.
19. COSMOS> GetDataManagerInfo http://www.eclipse.org/cosmos/stat/1 Passed Passed Passed None.
19a. COSMOS> GetDataManagerInfo http://www.eclipse.org/cosmos/logging/2 Passed Passed Passed None.
19b. COSMOS> GetDataManagerInfo http://www.eclipse.org/cosmos/TestFedCMDB/3 Passed Passed Passed None.
19c. COSMOS> GetDataManagerInfo http://www.eclipse.org/cosmos/examplemdr/4 Passed Passed Passed None.
19d. COSMOS> GetDataManagerInfo http://www.eclipse.org/cosmos/smlmdr/5 Passed Passed Passed None.
19e. COSMOS> GetDataManagerInfo http://www.eclipse.org/cosmos/aperimdr/6 Passed Passed Passed None.
20. COSMOS> GetSoapVersion http://www.eclipse.org/cosmos/stat/1 Passed Passed Passed None.
20a. COSMOS> GetSoapVersion http://www.eclipse.org/cosmos/logging/2 Passed Passed Passed None.
20b. COSMOS> GetSoapVersion http://www.eclipse.org/cosmos/TestFedCMDB/3 Passed Passed Passed None.
20c. COSMOS> GetSoapVersion http://www.eclipse.org/cosmos/examplemdr/4 Passed Passed Passed None.
20d. COSMOS> GetSoapVersion http://www.eclipse.org/cosmos/smlmdr/5 Passed Passed Passed None.
20e. COSMOS> GetSoapVersion http://www.eclipse.org/cosmos/aperimdr/6 Passed Passed Passed None.

COSMOS Web User Interface

Test Description Test Status 
 Windows XP SP2
Test Status 
 Windows 2003 SP1
Test Status 
 RHES 5.0
Remarks
1.Layout of the User Interface

http://localhost:8080/COSMOSUI/?page=cosmos

Passed Passed Passed All 3 panes - DataManagers,Details and Properties are visible properly
2.Data Managers View

http://localhost:8080/COSMOSUI/?page=cosmos

Passed Passed Passed Found All 6 DataManagers under COSMOS Web UI
3.StatDataManager (Monitoring Data Repository)

server 33 tomcat1181829221515 CBE -> Statistical Report

Passed Passed Passed Statistical Report generated successfully.
3a.StatDataManager (Monitoring Data Repository)

StatDataManager -> Properties...

Passed Passed Passed Able to set security properties information
4.LoggingDataManager (Logging Data Repository)

access_log.cbe.xml -> Top 10 Log Report

Passed Passed Passed Top 10 Log Report generated successfully.
4a.LoggingDataManager (Logging Data Repository)

windows_app_log.cbe.xml -> Top 10 Log Report

Passed Passed Passed Top 10 Log Report generated successfully.
4b.LoggingDataManager (Logging Data Repository)

LoggingDataManager -> Properties...

Passed Passed Passed Able to set security information properly
5.Resource Repository (SML MDR)

Resoure Repository->All Computer Systems

Passed Passed Passed Pre-defined CMDBf query for All Computer systems, executed successfully
5a.Resource Repository (SML MDR)

Resoure Repository->All Operating Systems

Passed Passed Passed Pre-defined CMDBf query for All Operating systems, executed successfully
5b.Resource Repository (SML MDR)

Resoure Repository->Operating System of Computer

Passed Passed Passed Pre-defined CMDBf query for 'Operating System of Computer', executed successfully
5c.Resource Repository (SML MDR)

Resoure Repository->New Folder...

Passed Passed Passed Able to create new folder
5d.Resource Repository (SML MDR)

Resoure Repository->Submit Query as Text

Passed Passed Passed Able to execute CMDBf queries successfully
5e.Resource Repository (SML MDR)

Resoure Repository->New Folder...->Delete

Passed Passed Passed Able to Delete custom folder successfully
5f.Resource Repository (SML MDR)

Resoure Repository->View MetaData

Passed Passed Passed Able to see appropriate metadata information - No Metadata available
5g.Resource Repository (SML MDR)

Resource Repository->Properties

Passed Passed Passed Able to set security properties properly
5h.Resource Repository (SML MDR)

Resource Repository->New Folder->New Folder...

Passed Passed Passed Able to create subfolder under existing folder
5i.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Open With>>->Tabular View

Passed Passed Passed Able to see CMDBf response data as Tabular view
5j.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Open With>>->Hierarchal View

Passed Passed Passed None.
5k.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Register Configuration Items...

Passed Passed Passed Partial registration works fine
5l.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->DeRegister Configuration Items...

Passed Passed Passed Partial deregistration works fine
5m.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Rename...

Passed Passed Passed Renaming Query or folder name works fine
5n.Resource Repository (SML MDR)

Resource Repository->New Folder->CMDBf Query..->Rename...

Passed Passed Passed Renaming Query or folder under subfolder is working fine
5o.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Refresh

Passed Passed Passed Refresh works fine
5p.Resource Repository (SML MDR)

Resource Repository->CMDBf Query..->Response History...

Passed Passed Passed Response History works fine with history data
6.Sample Repository with Query (EXAMPLE MDR)

Get All Students

Passed Passed Passed Displayed Query Result for Students data correctly
6a.Sample Repository with Query (EXAMPLE MDR)

Get All Teachers

Passed Passed Passed Displayed Query Result for Teachers data correctly
6b.Sample Repository with Query (EXAMPLE MDR)

Get All Classes

Passed Passed Passed Displayed Query Result for Classes data correctly
6c.Sample Repository with Query (EXAMPLE MDR)

Staff01

Passed Passed Passed Displayed data for 'students taught by teacher-staff01' correctly. There is some problem with staff01, sometimes it doesn't get expanded.
6d.Sample Repository with Query (EXAMPLE MDR)

Staff02

Passed Passed Passed Displayed data for 'students taught by teacher-staff02' correctly. There is some problem with staff02, sometimes it doesn't get expaned.
6e.Sample Repository with Query (EXAMPLE MDR)

Submit Query

Passed Passed Passed Using Query Builder, able to create and execute queries correctly. There is some problem with relationship queries, where it's not showing result correctly
6f.Sample Repository with Query (EXAMPLE MDR)

Submit Query as Text

Passed Passed Passed Able to execute CMDBf queries successfully
6g.Sample Repository with Query (EXAMPLE MDR)

View MetaData

Passed Passed Passed Displayed MetaData information correctly
6h.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->Properties

Passed Passed Passed Able to set Security information correctly
6i.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->New Folder...

Passed Passed Passed Able to create New Folder correctly
6j.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->New Folder->New Folder...

Passed Passed Passed Able to create Sub Folder under existing folder correctly
6k.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->CMDBf Query..->Open With>>->Tabular View

Passed Passed Passed Able to see tabular view of CMDBf query result data correctly, Having some problem with IE
6l.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->CMDBf Query..->Open With>>->Hierarchal View

Passed Passed Passed Able to see Hierarchial view of CMDBf query result data correctly
6m.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->CMDBf Query..->Register Configuration Items...

Passed Passed Passed Able to do partial registration correctly
6n.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->CMDBf Query..->DeRegister Configuration Items...

Passed Passed Passed Able to do partial deregistration correctly
6o.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->CMDBf Query..->Rename...

Passed Passed Passed Able to Rename Query or folder name correctly
6p.Sample Repository with Query (EXAMPLE MDR)

Sample Repository with Query->New Folder->CMDBf Query...->Rename...

Passed Passed Passed Able to Rename Query or folder under existing folder
6q.Sample Repository with Query (EXAMPLE MDR)

Sample Reposotiry with Query->CMDBf Query..->Refresh

Passed Passed Passed CMDBf Query refresh works fine
6r.Sample Repository with Query (EXAMPLE MDR)

Sample Reposotiry with Query->CMDBf Query..->Response History...

Passed Passed Passed Response history works fine with history data
6s.Sample Repository with Query (EXAMPLE MDR)

Sample Reposotiry with Query->New Folder...->Delete

Passed Passed Passed Able to delete folder successfully
7.Sample Repository with Registration (Federating CMDB)

All Items and Relationships

Passed Passed Passed Pre-defined Query - All Items and Relationships executed successfully
7a.Sample Repository with Registration (Federating CMDB)

Submit Query as Text

Passed Passed Passed Able to run CMDBf queries successfully (same as Submit Query as Text)
7b.Sample Repository with Registration (Federating CMDB)

Register Configuration Items...->select "Sample Repository with Query"

Passed Passed Passed Full Registration with Example MDR is successful
7c.Sample Repository with Registration (Federating CMDB)

Register Configuration Items...->select "Resource Repository"

Passed Passed Passed Full Registration with SML MDR is successful
7d.Sample Repository with Registration (Federating CMDB)

Register Configuration Items...->select "Storage Repository"

Failed Failed Failed Full Registration with AperiMdr - Failed (No response on UI)
7e.Sample Repository with Registration (Federating CMDB)

Deregister Configuration Items...->select "Sample Repository with Query"

Passed Passed Passed Full Deregistration with Example MDR is successful
7f.Sample Repository with Registration (Federating CMDB)

Deregister Configuration Items...->select "Resource Repository"

Passed Passed Passed Full Deregistration with SML MDR is successful
7g.Sample Repository with Registration (Federating CMDB)

Deregister Configuration Items...->select "Storage Repository"

Failed Failed Failed Full Deregistration with Aperi MDR - Failed
7h.Sample Repository with Registration (Federating CMDB)

register Configuration Items...->select "Sample Repository with Query" and "Resource Repository"

Passed Passed Passed Full registration with Example Mdr and SML Mdr - Passed
7i.Sample Repository with Registration (Federating CMDB)

Deregister Configuration Items...->select "Sample Repository with Query" and "Resource Repository"

Passed Passed Passed Full deregistration with Example Mdr and SML Mdr - Passed
7j.Sample Repository with Registration (Federating CMDB)

New Folder...

Passed Passed Passed Able to create New Folder successfully
7k.Sample Repository with Registration (Federating CMDB)

CMDBf Query..->Rename...

Passed Passed Passed Able to rename Query/Folder successfully
7l.Sample Repository with Registration (Federating CMDB)

Properties...

Passed Passed Passed Able to set Security Information correctly
7m.Sample Repository with Registration (Federating CMDB)

CMDBf Query..->Open With>>->Tabular View

Passed Passed Passed Able to view CMDBf query result under Tabular view properly (IE is having some problem)
7n.Sample Repository with Registration (Federating CMDB)

CMDBf Query..->Open With>>->Hierarchial View

Passed Passed Passed Hierarchial View of CMDBf result data working properly
7o.Sample Repository with Registration (Federating CMDB)

CMDBf Query..->Refresh

Passed Passed Passed CMDBf Query refresh is working fine
7p.Sample Repository with Registration (Federating CMDB)

View MetaData

Passed Passed Passed Able to view appropriate message for View MetaData
7q.Sample Repository with Registration (Federating CMDB)

Response History...

Passed Passed Passed Able to view Response Histories with last queried data
7q.Sample Repository with Registration (Federating CMDB)

New Folder...->delete

Passed Passed Passed Able to delete folder successfully
8a.AperiMDR (Storage Repository)

New Folder...

Passed Passed Passed None
8b.AperiMDR (Storage Repository)

Submit Query

Passed Passed Passed Using Query builder able to execute and validate queries properly
8c.AperiMDR (Storage Repository)

Submit Query as Text

Passed Passed Passed Able to execute CMDBf queries correctly
8d.AperiMDR (Storage Repository)

View MetaData

Passed Passed Passed Displayed MetaData properly
8e.AperiMDR (Storage Repository)

Properties...

Passed Passed Passed Able to set security properties properly
8f.AperiMDR (Storage Repository)

CMDBf Query->Open With >>->Tabular View

Passed Passed Passed Able to view Tabular View of CMDBf query response data
8g.AperiMDR (Storage Repository)

CMDBf Query->Open With >>->Hierarchial View

Passed Passed Passed Able to view Hierarchial View of CMDBf query response data
8h.AperiMDR (Storage Repository)

CMDBf Query->Register Configuration Items...

Passed Passed Passed Partial registration with FederatingCMDB works fine
8i.AperiMDR (Storage Repository)

CMDBf Query->DeRegister Configuration Items...

Passed Passed Passed Partial Deregistration with FederatingCMDB works fine
8k.AperiMDR (Storage Repository)

CMDBf Query->Rename...

Passed Passed Passed Renaming Query or folder names works fine
8l.AperiMDR (Storage Repository)

New Folder->CMDBf Query->Rename...

Passed Passed Passed Renaming Query or folder names under subfolder - Works fine
8m.AperiMDR (Storage Repository)

CMDBf Query->Refresh

Passed Passed Passed CMDBf query refresh work fine
8n.AperiMDR (Storage Repository)

CMDBf Query->Response History...

Passed Passed Passed Response History is working fine
8o.AperiMDR (Storage Repository)

New Folder...->delete

Passed Passed Passed Able to delete query/folder successfully
9.Full screen mode toolbar button
  • DataManagers list with Full Screen mode
  • Details Pane with Full Screen mode
  • Properties Pane with Full Screen mode
 Passed Passed Passed Able to view all(DataMangers/Properties/Details) panes in fullscreen mode correctly
10.CMDB Graph Response Report
  • ExampleMDR->pre-canned queries->visualize CMDBf Graph Report
  • SMLMDR->pre-canned queries->visualize CMDBf Graph Report
  • AperiMDR->pre-canned queries->visualize CMDBf Graph Report
  • FederatingCMDB->cmdbf query->visualize CMDBf Graph Report
  • custom CMDBf queries->visualize CMDBf Graph Report
 Passed Passed Passed Able to view CMDB Graph Response reports for all CMDBf queris.

Data Visualization TPTP Manual Tests Execution

DataVisualization.UI.Component.Widget.testsuite

/org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Component.Widget.testsuite

Test Description Test Status 
 Windows XP SP2
Test Status 
 RHES 5.0
Remarks
1.navigate Passed Passed None
2.navigate2 Passed Passed Able to execute given query, but no data found to verify. Executed existing pre-canned query and validated the data
3.properties Passed Passed Properties data have been changed in 12, it now contains - name,mdrid,description,soapNamespace,recordTypeNamespace and securityNamespace.
4.visualize log report Passed Passed Top 10 Log Report generated successfully without any errors. Under linux had some problem with reportDeployment.xml file, fixed locally and tested.
5.visualize stat report Passed Passed Statistical Report generated successfully. Under linux had some problem with reportDeployment.xml file, fixed locally and tested.
6.properties 2 Passed Passed Properties for all Data Managers have been verified and found to be correct
7.Multiple Graph Response Viewers Passed Passed Able to view multiple Graph response viewer and all data found to be correct
8.Registration Example Passed Passed Full registration of ExampleMDR with FederatingCMDB is successful
9.DeRegistration Example Passed Passed Full deregistration of ExampleMDR with FederatingCMDB is successful
10.Partial Registration of MDR with CMDBf Passed Passed Partial registration of SMLMDR - predefined query data with FederatingCMDB is successful
11.Partial DeRegistration of MDR with CMDBf Passed Passed Partial deregistration of SMLMDR - predefined query data with FederatingCMDB is successful
12.Creating Named Query Passed Passed Creation of Named Query and execution successful
13.Rename a Query Passed Passed Renaming a Query works fine
14.Creating a Query Folder Passed Passed Able to create New Folder successfully
15.Rename a folder Passed Passed Renaming folder works fine
16.Enter Security Info Passed Passed Able to enter security data under "Properties" window and query execution is successful.
17.Save Queries Passed Passed Able to save queries and response histories
18.Using Submit Query as Text Passed Passed "Submit Query as Text" works fine.
19.Query Properties Passed Passed Able to view Query properties under botton right section of UI page under heading "CMDBfQueryDocument"
20.Hierarchical Items Passed Passed Able to view hierarchical items for given scenario correctly
21.Hierarchical Relationships Passed Passed Hierarchical Relationships data for "Staff01" query displayed correctly.
22.Hierarchical Sample Registration Passed Passed Hierachical Sample Registration - data execution and validation is successful
23.Visualize CMDB Graph Report Passed Passed Able to view CMDB Graph report properly for "Sample Repository with Query>Get All Classes" node
24.Visualize CMDB Graph Report 1 Passed Passed Able to view CMDB Graph report properly for "Sample Repository with Query>Get All Students" node
25.Visualize CMDB Graph Report 2 Passed Passed Able to view CMDB Graph report properly for "Sample Repository with Query>Get All Teachers" node

DataVisualization.UI.Reports.testsuite

/org.eclipse.cosmos.examples.e2e.tests/manual/DataVisualization.UI.Reports.testsuite

Test Description Test Status 
 Windows XP SP2
Test Status 
 RHES 5.0
Remarks
1.LogReport Passed Passed LogReport generated successfully
2.StatReport Passed Passed StatReport generated successfully

Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)

ManagementEnablement.UI.dmtoolkit.testsuite

/org.eclipse.cosmos.me.dmtoolkit.tests/manual/ManagementEnablement.UI.dmtoolkit.testsuite

Test Description Test Status 
 Windows XP SP2
Remarks
1.Creating a Data Manager Project Passed Data Manager Project Creation wizard, executed successfully
2.Facet Interface for creating DM Project Passed Facet Interface for creating DM Project, executed successfully
3.Run on Server Passed Able to run and see MDR under COSMOSUI successfully
4.Using Web UI Passed Able to run sample query successfully

SML Tooling tests (UI Validation)

  • SML editor/import/export UI validation tests
  • /org.eclipse.cosmos.rm.smlif.tests/manual/TestNewSMLIF.testsuite
  • /org.eclipse.cosmos.rm.smlif.tests/manual/TestSMLIFValidator.testsuite
  • /org.eclipse.cosmos.rm.smlif.tests/manual/TestImportOperation.testsuite
  • /org.eclipse.cosmos.rm.smlif.tests/manual/TestExportOperation.testsuite


Test Description Test Status 
 Windows XP SP2
Remarks
1.Creating a New SML-IF File Passed Able to create and validate new SML-IF file successfully
2.Validate SML-IF File from Eclipse Context Menu - invocation Passed Able to validate SML-IF file successfully
3.Validate SML-IF file using SML-IF Editor - invocation Passed Able to validate SML-IF file successfully
4.Using SML-IF Import from Eclipse Context Menu - invocation Passed Able to import SML files from SML-IF file successfully
5.Import SML-IF Files into repository using SML-IF Editor - invocation Passed Able to import SML files from SML-IF file successfully
6.Using SML-IF Export from Eclipse Context Menu - invocation Passed Able to export SML-IF file from SML units successfully

Execution of i14 supplement e2e tests (negative) from QA.

Build Installation and Configuration

Test Description Test Status 
 Windows XP SP2
Test Status 
 RHES 5.0
Remarks
1.Installing COSMOS Web applications and Web Services - tomcatDir with spaces running on port 8090

<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <axis2war-path>

Passed Passed None

COSMOS Command Line Client

Test Description Test Status 
 Windows XP SP2
Test Status 
 RHES 5.0
Remarks
1. Register All Data Managers with Broker (running on port 8090)

COSMOS> RegisterAllDataManagers

Passed Passed All Data Managers registered to 8090 port successfully
1a. Register All Data Managers with Broker (re-doing registration again)
  • COSMOS> RegisterAllDataManagers
  • COSMOS> RegisterAllDataManagers
 Passed Passed Found appropriate error message as - "Duplicate Registration for <datamanager-name>"
1b. Register All Data Managers with Broker (with invalid Broker EPR) Passed Passed Displays appropriate error message as 'The service cannot be found for the endpoint reference (EPR) http://localhost:8090/axis2/services/MyBroker'
2. Registering Individual Data Manager with Broker (running on port 8090)

COSMOS> Register http://www.eclipse.org/cosmos/aperimdr/6

Passed Passed Registered successfully and displayed message as 'Registering Storage Repository ;

Storage Repository Registered'

2a. Registering Individual Data Manager with Broker (registring multiple times)

COSMOS> Register http://www.eclipse.org/cosmos/aperimdr/6 COSMOS> Register http://www.eclipse.org/cosmos/aperimdr/6

Passed Passed Registration fails with appropriate message as "Duplicate Registration for Storage Repository"
2b. Registering Individual Data Manager with Broker (with invalid Broker EPR) Passed Passed Registration fails with appropriate error message as "The service cannot be found for the endpoint reference (EPR) http://localhost:8090/axis2/services/MyBroker"
2c. Registering Individual Data Manager with Broker (with Invalid DataManager Name)

COSMOS> Register http://www.eclipse.org/cosmos/aperimdr/16

Passed Passed Displays message as 'Not Found!'
3. Registering ServiceGroup (registering Multiple times) Passed Passed Displays appropriate error message as - "Duplicate Registration for Storage Repository"
3a. Registering ServiceGroup (with invalid/non-existing WSDL files)

COSMOS> RegisterServiceGroup localhost "Storage Repository" http://www.eclipse.org/cosmos/aperimdr/6 http://www.w3.org/2003/05/soap-envelope http://www.eclipse.org/cosmos/aperimdr http://www.eclipse.org/cosmos/security/basic http://localhost:8090/axis2/services/MyAperiMdrQueryService?wsdl

Passed Passed Displayed error message as 'Could not get WSDL!'
3b. Registering ServiceGroup (with invalid Broker EPR)

COSMOS> RegisterServiceGroup localhost StorageRepository http://www.eclipse.org/cosmos/aperimdr/6 http://www.w3.org/2003/05/soap-envelope http://www.eclipse.org/cosmos/aperimdr http://www.eclipse.org/cosmos/security/basic http://localhost:8090/axis2/services/MyAperiMdrQueryService?wsdl

Passed Passed Displayed appropriate error message as 'The service cannot be found for the endpoint reference (EPR) http://localhost:8090/axis2/services/MyBroker'
4. List All Data Managers Registered with Broker (With no registration)

COSMOS> GetDataManagers

Passed Passed Display empty response with message 'Data managers registered at the broker:'
4a. List All Data Managers Registered with Broker (With invalid broker EPR)

COSMOS> GetDataManagers

Passed Passed Displays appropriate error message as "The service cannot be found for the endpoint reference (EPR) http://localhost:8090/axis2/services/MyBroker"
5. Find all DataManagers using CosmosServiceFinder web service (Invalid CosmosServiceFinder EPR)

COSMOS> FindDataManagers http://localhost:8090/axis2/services/myCosmosServiceFinder

Passed Passed Displays appropriate message as 'The service cannot be found for the endpoint reference (EPR) http://localhost:8090/axis2/services/myCosmosServiceFinder'
5a. Find all DataManagers using CosmosServiceFinder web service (with no DataManagers deployed)

COSMOS> FindDataManagers http://localhost:8090/axis2/services/CosmosServiceFinder

Passed Passed None
6. Deregistering Data Managers from broker (with Port 8090)

COSMOS> Deregister http://www.eclipse.org/cosmos/stat/1

Passed Passed DataManager deregistered successfully.
6a. Deregistering Data Managers from broker (with invalid Datamanager id)

COSMOS> Deregister http://www.eclipse.org/cosmos/logging/12

Passed Passed Displayed appropriate error message as 'Failure to deregister DataManager'
6b. Deregistering Data Managers from broker (deregistring multiple times) Passed Passed Displayed appropriate error message as 'Failure to deregister DataManager'
7. Executing CMDBf Queries using the command line client (Query Path with spaces)

COSMOS> GraphQuery http://www.eclipse.org/cosmos/examplemdr/4 "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt"

Passed Passed GraphQuery executed successfully.
7a. Executing CMDBf Queries using the command line client (Incorrect path)

COSMOS> GraphQuery http://www.eclipse.org/cosmos/examplemdr/4 "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students_2.txt"

Passed Passed Displayed error as "java.io.FileNotFoundException"
7b. Executing CMDBf Queries using the command line client (Wrong Query)

COSMOS> GraphQuery http://www.eclipse.org/cosmos/smlmdr/5 "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt"

Passed Passed Empty Response
7c. Executing CMDBf Queries using the command line client (Invalid DataManager id)

COSMOS> GraphQuery http://www.eclipse.org/cosmos/examplemdr/14 "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt"

Passed Passed Displayed error message as "unknown" - Needs more appropriate message here ?
7d. Executing CMDBf Queries using the command line client (with Inactive DataManager) Passed Passed Displayed error as "unknown" - Needs more appropriate message here ?
7e. Executing CMDBf Queries using the command line client (with no Aperi DB startup)

COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 "C:\Program Files\cosmos\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_pool.xml"

Passed Passed Displayed DB Connection error message - Needs more appropriate message here.
8 Broker epr change test scenario Passed Passed All DataManagers registered with second broker displayed correctly
9 Get Data Managers information by id (Valid id) Passed Passed Displayed AperiMdr datamanager information correctly
9a Get Data Managers information by id (invalid id) Passed Passed Diplayed appropriate error message as "DataManager with Id http://www.eclipse.org/cosmos/aperimdr/16 not found"
10 Get Data Managers information by RecordNameSpace (Valid Namespace) Passed Passed Displayed AperiMdr datamanager information correctly
10a Get Data Managers information by RecordNamespace (invalid Namespace) Passed Passed Displayed appropriate message as - "DataManager with Record Type Namespace http://www.eclipse.org/cosmos/myaperimdr not found"
11 Get Data Managers information by id (Valid mdrid) Passed Passed Displayed AperiMdr datamanager information correctly
11a Get Data Managers information by id (invalid mdrid) Passed Passed Displayed appropriate error message as "DataManager with Id http://www.eclipse.org/cosmos/aperimdr/16 not found"
12 Get SOAP Version by id (Valid mdrid) Passed Passed Displayed SOAP version as "SoapVersion: 1.2"
12a Get SOAP Version by id (invalid mdrid) Passed Passed Displayed appropriate error message as "DataManager with Id http://www.eclipse.org/cosmos/aperimdr/16 not found"

COSMOS Web User Interface

Test Description Test Status 
 Windows XP SP2
Test Status 
 RHES 5.0
Remarks
1.Layout of the User Interface (with port 8090) Passed Passed All 3 panes - DataManagers,Details and Properties are visible properly and all 6 DataManagers are displayed correctly
2.Resource Repository (SML MDR)(with Invalid FolderName)

Resoure Repository->New Folder...

Passed Passed Able to create new folder with any kind of name
2a.Resource Repository (SML MDR)(with existing FolderName)

Resoure Repository->New Folder...

Passed Passed Able to create duplicate folder/query name
2b.Resource Repository (SML MDR) (with invalid Query data)

Resoure Repository->Submit Query...

Passed Passed Query execution failed, and displays appropriate error
2c.Resource Repository (SML MDR) (Invalid filename with spaces)

Resource Repository->CMDBf Query..->Rename...

Passed Passed Renaming Query or folder name with any junk values works
3.Sample Repository with Query (EXAMPLE MDR) (Invalid Query data)

Submit Query

Passed Passed Using Query Builder, able to create and execute invalid/incomplete query and on execution found an appropriate error message
3a.Sample Repository with Query (EXAMPLE MDR) (invalid query data)

Submit Query as Text

Passed Passed Able to execute invalid CMDBf query and found an appropriate error message
4.Sample Repository with Registration (Federating CMDB) (Multiple Selections of DM)

Register Configuration Items...->select all 3 Data Managers

Passed Passed Full Registration with AperiMDR is not working, other combinations of DM's are working fine
4a.Sample Repository with Registration (Federating CMDB)(Multiple Selection)

DeRegister Configuration Items...->select all 3 Data Managers

Passed Passed Full DeRegistration with AperiMDR is not working, other combinations of DM's are working fine
4b.AperiMDR (Storage Repository) (with no Aperi DB setup)

Submit Query

Passed Passed Using Query builder able to create and execute queries. Upon execution, query resulted in error with appropriate Database connectivity message.
4c.AperiMDR (Storage Repository) (Invalid Query Data)

Submit Query as Text

Passed Passed Able to execute invalid CMDBf query and upon execution found appropriate error message
5.ExampleMdr (Storage Repository with Query) (Invalid Query Relationship)
  • Create relationship Query with non-existing localid and submit query as text
  • Example, copy staff01 query and modify localid as "mystaff01" and submit the query
 Failed Failed Query executed successfully and displayed all students data, whereas it should display empty response as there is no relationship to given localid
6. Launching the COSMOS UI with a MDR query - ExampleMdr Passed Passed Query executed successfully and displayed all students data under Graph Response Viewer
6a. Launching the COSMOS UI with a MDR query - SMLMDR Passed Passed Query executed successfully and displayed output data under Graph Response Viewer
6b. Launching the COSMOS UI with a MDR query - AperiMdr Passed Passed Query executed successfully and displayed output data under Graph Response Viewer
6c. Launching the COSMOS UI with a MDR query - ExampleMdr (invalid query) Passed Passed Query executed successfully and displayed empty GraphResponseViewer
7. Testing Broker Attributes for ExampleMdr with cosmos.properties Passed Passed Modified Broker attributes displayed correctly


Basic operational efficiency tests (limited performance tests)

Configuration Tests

Test Description Test Status Remarks
1.Testing the scenario where COSMOSUI,COSMOSReportViewer running on windows PC1,broker running on windows PC2 and all datamanagers running on linux PC1
  • Install and deploy COSMOSUI,COSMOSReportViewer applications under windows PC1 (WinXP)
  • Install and deploy COSMOS Broker service under windows PC2 (Win2k3)
  • Install and deploy COSMOS Data Managers/MDR's services and ServiceFinder service under linux PC1
  • Now Open COSMOS Command line interface from any of the PC's with Broker URL,

<cosmos-demo>/cosmosClient/bin/cosmosClient.bat http://<WindowsPC2host>:8080/axis2/services/Broker COMSOS>RegisterAllDataManagers http://<linuxPC1host:8080>/axis2/services/CosmosServiceFinder

  • Now Modify BROKER EPR value under <COSMOSUI>/Configuration.properties file, pointing to windows PC2 hostname
  • Inspect the properties of all datamanagers
  • Expected Result:
    • COSMOS UI should display all 6 Data Managers and all it's operations should work normally
Passed COSMOS UI works fine with this setup.
2.Testing the scenario where COSMOSUI running on windows and all COSMOS services running on Linux
  • Install COSMOS service components under linux box
  • Install COSMOSUI,COSMOSReportViewer webapps application under windows
  • Modify BROKER EPR value under <COSMOSUI>/Configuration.properties file, pointing to linux hostname
  • From windows, open http://localhost:8080/COSMOSUI
  • Expected Result:
    • COSMOS UI should display all 6 Data Managers and all it's operations should work normally
Passed COSMOS UI works fine with this setup.

Concurrency Tests

Test Description Test Status Remarks
1.Concurrency tests, where multiple COSMOSUI's running on one machine
  • Install all COSMOS components on windows PC
  • open 2 COSMOSUI's under IE and 2 COSMOSUI's under Firebox browsers
  • Perform various test operations - Generating Stat/Log reports on all COSMOSUI's
  • simultaneously,Executing CMDBf queries on all COSMOSUI's simultaneously
  • Expected Result:
    • All COSMOS UI's should work normally and should get appropriate results without any errors
Passed None
2.Concurrency tests, where multiple COSMOSUI's and multiple COSMOS Command Line Clients running on one machine
  • Install all COSMOS components on windows PC
  • open 1 COSMOSUI under IE and 1 COSMOSUI under Firebox browser
  • open 2 COSMOS Command Line Shells
  • Perform various test operations - Execute CMDBf queries on all COSMOS Clients simultaneously
  • Expected Result:
    • All COSMOS clients should work normally and should get appropriate results without any errors
Passed None

Volume/Performance Tests

Retrieved from "https://wiki.eclipse.org/index.php?title=COSMOS_i14_QA_Phase_Execution&oldid=127928"

Back to the top