Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "COSMOS i14 QA Phase Execution"
(→Execution of i14 supplement e2e tests (negative) from QA.) |
(→i14 ERs – JUnits/Manual Tests inspection) |
||
Line 1,301: | Line 1,301: | ||
==i14 ERs – JUnits/Manual Tests inspection == | ==i14 ERs – JUnits/Manual Tests inspection == | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
== Basic operational efficiency tests (limited performance tests)== | == Basic operational efficiency tests (limited performance tests)== |
Revision as of 08:05, 29 October 2008
Contents
- 1 QA Test Execution Activities for i14
- 2 QA i14 Execution - Complete Status
- 2.1 E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0
- 2.2 Data Visualization TPTP Manual Tests Execution
- 2.3 Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)
- 2.4 Execution of i14 supplement e2e tests (negative) from QA.
- 2.5 i14 ERs – JUnits/Manual Tests inspection
- 2.6 Basic operational efficiency tests (limited performance tests)
QA Test Execution Activities for i14
Planned QA Activities for i14
Primary Tasks:
1. E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0
2. i14 ERs – JUnits/Manual Tests inspection
3. Data Visualization TPTP Manual Tests Execution
- DataVisualization.UI.Component.Widget.testsuite / UI.Reports.testsuite
4. Execution of i14 supplement e2e tests (negative) from QA.
5. Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)
- org.eclipse.cosmos.me.dmtoolkit.tests/ManagementEnablement.UI.dmtoolkit.testsuite
- SML Tooling - adhoc UI testing for editor/validator/import/export features
Secondary Tasks:
6. Basic operational efficiency tests (limited performance tests)
For complete i14 QA Activities, refer http://wiki.eclipse.org/COSMOS_QA_i14_Activities
QA i14 Test Execution Summary
QA i14 Execution - Complete Status
- Refer test cases at http://wiki.eclipse.org/COSMOS_QA_End2End_Tests#COSMOS_End2End_Tests
- Refer COSMOS i12 demo page - http://wiki.eclipse.org/COSMOS_DEMO_i14
E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0
Build Installation and Configuration
Test Description | Test Status
Windows XP SP2 |
Test Status
Windows 2003 SP1 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|---|
1.Download COSMOS Demo and Prerequisites | Passed | Passed | Passed | None |
2.Installing COSMOS Web applications and Web Services
<cosmos-demo>/bin/configDemo.bat <tomcatDir> <cosmosDir> <birt-path> <axis2war-path> |
Passed | Passed | Passed | None |
3.Installing COSMOS SDK | Passed | Passed | Passed | None |
4.Installing Resource Modeling Tooling | Passed | Passed | Passed | None |
COSMOS Command Line Client
Test Description | Test Status
Windows XP SP2 |
Test Status
Windows 2003 SP1 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|---|
1. Start the COSMOS Command Line Client
<cosmos-demo>\cosmos-client\cosmosClient.bat http://localhost:8080/axis2/services/Broker |
Passed | Passed | Passed | None |
2. Security Header - Set SoapVersion
COSMOS> Setsoapversion 1.2 |
Passed | Passed | Passed | None |
3. Security Header - Set username/password
COSMOS> Setcredentials test test123 |
Passed | Passed | Passed | None |
4. Security Header - Show Details
COSMOS> Settings |
Passed | Passed | Passed | None |
5. Register All Data Managers with Broker
COSMOS> RegisterAllDataManagers |
Passed | Passed | Passed | None |
6. Registering Individual Data Manager with Broker - AperiMdr
COSMOS> Register http://www.eclipse.org/cosmos/aperimdr/6 |
Passed | Passed | Passed | Storage Repository Registered |
6a. Registering Individual Data Manager with Broker - SMLMDR
COSMOS> Register http://www.eclipse.org/cosmos/smlmdr/5 |
Passed | Passed | Passed | None |
6b. Registering Individual Data Manager with Broker - ExampleMdr
COSMOS> Register http://www.eclipse.org/cosmos/examplemdr/4 |
Passed | Passed | Passed | None |
6c. Registering Individual Data Manager with Broker - TestFederatingCMDB
COSMOS> Register http://www.eclipse.org/cosmos/TestFedCMDB/3 |
Passed | Passed | Passed | None |
6d. Registering Individual Data Manager with Broker - LoggingDataManager
COSMOS> Register http://www.eclipse.org/cosmos/logging/2 |
Passed | Passed | Passed | None |
6e. Registering Individual Data Manager with Broker - StatDataManager
COSMOS> Register http://www.eclipse.org/cosmos/stat/1 |
Passed | Passed | Passed | None |
7. Registering ServiceGroup
COSMOS> RegisterServiceGroup domsr01-xp "Storage Repository" http://www.eclipse.org/cosmos/aperimdr/6 http://www.w3.org/2003/05/soap-envelope http://www.eclipse.org/cosmos/aperimdr http://www.eclipse.org/cosmos/security/basic http://domsr01-xp:8080/axis2/services/AperiMdrQueryService?wsdl |
Passed | Passed | Passed | ServiceGroup registered successfully, displayed message as "Ok" - Needs more appropriate message? |
8. Print Broker EPR
COSMOS> PrintBrokerEPR |
Passed | Passed | Passed | The current Broker EPR being used is http://localhost:8080/axis2/services/Broker |
10. Modifiying Broker EPR
COSMOS> ChangeBrokerEPR http://localhost:8090/axis2/services/Broker |
Passed | Passed | Passed | None |
11. List All Data Managers Registered with Broker
COSMOS> GetDataManagers |
Passed | Passed | Passed | None |
12. Find all DataManagers using CosmosServiceFinder web service
COSMOS> FindDataManagers http://localhost:8080/axis2/services/CosmosServiceFinder |
Passed | Passed | Passed | None |
13. Deregistering Data Managers from broker
COSMOS> Deregister http://www.eclipse.org/cosmos/stat/1 |
Passed | Passed | Passed | None |
13a. COSMOS> Deregister http://www.eclipse.org/cosmos/logging/2 | Passed | Passed | Passed | None |
13b. COSMOS> Deregister http://www.eclipse.org/cosmos/TestFedCMDB/3 | Passed | Passed | Passed | None |
13c. COSMOS> Deregister http://www.eclipse.org/cosmos/examplemdr/4 | Passed | Passed | Passed | None |
13d. COSMOS> Deregister http://www.eclipse.org/cosmos/smlmdr/5 | Passed | Passed | Passed | None |
13e. COSMOS> Deregister http://www.eclipse.org/cosmos/aperimdr/6 | Passed | Passed | Passed | None |
14. Executing CMDBf Queries using the command line client
COSMOS> GraphQuery http://www.eclipse.org/cosmos/smlmdr/5 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testInstanceIdQuery.txt |
Passed | Passed | Passed | Empty Response |
14a. COSMOS> GraphQuery http://www.eclipse.org/cosmos/smlmdr/5 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\SMLMDR\testPropertyQuery.txt | Passed | Passed | Passed | Empty Response |
15. COSMOS> GraphQuery http://www.eclipse.org/cosmos/examplemdr/4 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-students.txt | Passed | Passed | Passed | Under linux for all GraphQueries, if we provide quotes(") over path, it is throwing error message as "Missing <query filename>" |
15a. COSMOS> GraphQuery http://www.eclipse.org/cosmos/examplemdr/4 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\all-teachers.txt | Passed | Passed | Passed | None |
15b. COSMOS> GraphQuery http://www.eclipse.org/cosmos/examplemdr/4 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\relationship-all-classes.txt | Passed | Passed | Passed | None |
15c. COSMOS> GraphQuery http://www.eclipse.org/cosmos/examplemdr/4 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\ExampleMDR\teaches-relationship.txt | Passed | Passed | Passed | None |
16. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_all.xml | Passed | Passed | Passed | None |
16a. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_all_items.xml | Passed | Passed | Passed | None |
16b. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_disk.xml | Passed | Passed | Passed | None |
16c. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_hostport.xml | Passed | Passed | Passed | None |
16e. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_inst_system.xml | Passed | Passed | Passed | None |
16f. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_pool.xml | Passed | Passed | Passed | None |
16g. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_pool_volume_all.xml | Passed | Passed | Passed | None |
16h. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_pool_volume_constr.xml | Passed | Passed | Passed | None |
16i. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_disk_all.xml | Passed | Passed | Passed | None |
16j. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_disk_constr.xml | Passed | Passed | Passed | None |
16k. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_hostport_all.xml | Passed | Passed | Passed | None |
16l. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_hostport_constr.xml | Passed | Passed | Passed | None |
16m. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pool_prop.xml | Passed | Passed | Passed | None |
16n. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pools_all.xml | Passed | Passed | Passed | None |
16o. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_pools_constr.xml | Passed | Passed | Passed | None |
16p. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_volume_all.xml | Passed | Passed | Passed | None |
16q. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_rel_system_volume_constr.xml | Passed | Passed | Passed | None |
16r. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system.xml | Passed | Passed | Passed | None |
16s. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_constr.xml | Passed | Passed | Passed | None |
16t. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_inst_prop.xml | Passed | Passed | Passed | None |
16u. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_system_like.xml | Passed | Passed | Passed | None |
16v. COSMOS> GraphQuery http://www.eclipse.org/cosmos/aperimdr/6 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\Aperi\query_volume.xml | Passed | Passed | Passed | None |
16w. COSMOS> GraphQuery http://www.eclipse.org/cosmos/TestFedCMDB/3 C:\cosmos\i14\cosmos-demo\cosmos-client\cmdbfQuery\TestFederatingCMDB\all_items.txt | Passed | Passed | Passed | None. |
17. COSMOS> GetDataManagerById http://www.eclipse.org/cosmos/stat/1 | Passed | Passed | Passed | None. |
17a. COSMOS> GetDataManagerById http://www.eclipse.org/cosmos/logging/2 | Passed | Passed | Passed | None. |
17b. COSMOS> GetDataManagerById http://www.eclipse.org/cosmos/TestFedCMDB/3 | Passed | Passed | Passed | None. |
17c. COSMOS> GetDataManagerById http://www.eclipse.org/cosmos/examplemdr/4 | Passed | Passed | Passed | None. |
17d. COSMOS> GetDataManagerById http://www.eclipse.org/cosmos/smlmdr/5 | Passed | Passed | Passed | None. |
17e. COSMOS> GetDataManagerById http://www.eclipse.org/cosmos/aperimdr/6 | Passed | Passed | Passed | None. |
18. COSMOS> GetDataManagersByRecordTypeNamespace http://www.eclipse.org/cosmos/stat | Passed | Passed | Passed | None. |
18a. COSMOS> GetDataManagersByRecordTypeNamespace http://www.eclipse.org/cosmos/testfedcmdb | Passed | Passed | Passed | None. |
18b. COSMOS> GetDataManagersByRecordTypeNamespace http://schemas.serviceml.org/sml/2007/02 | Passed | Passed | Passed | None. |
18c. COSMOS> GetDataManagersByRecordTypeNamespace http://www.eclipse.org/cosmos/logging | Passed | Passed | Passed | None. |
18d. COSMOS> GetDataManagersByRecordTypeNamespace http://www.eclipse.org/cosmos/examplemdr | Passed | Passed | Passed | None. |
18e. COSMOS> GetDataManagersByRecordTypeNamespace http://www.eclipse.org/cosmos/aperimdr | Passed | Passed | Passed | None. |
19. COSMOS> GetDataManagerInfo http://www.eclipse.org/cosmos/stat/1 | Passed | Passed | Passed | None. |
19a. COSMOS> GetDataManagerInfo http://www.eclipse.org/cosmos/logging/2 | Passed | Passed | Passed | None. |
19b. COSMOS> GetDataManagerInfo http://www.eclipse.org/cosmos/TestFedCMDB/3 | Passed | Passed | Passed | None. |
19c. COSMOS> GetDataManagerInfo http://www.eclipse.org/cosmos/examplemdr/4 | Passed | Passed | Passed | None. |
19d. COSMOS> GetDataManagerInfo http://www.eclipse.org/cosmos/smlmdr/5 | Passed | Passed | Passed | None. |
19e. COSMOS> GetDataManagerInfo http://www.eclipse.org/cosmos/aperimdr/6 | Passed | Passed | Passed | None. |
20. COSMOS> GetSoapVersion http://www.eclipse.org/cosmos/stat/1 | Passed | Passed | Passed | None. |
20a. COSMOS> GetSoapVersion http://www.eclipse.org/cosmos/logging/2 | Passed | Passed | Passed | None. |
20b. COSMOS> GetSoapVersion http://www.eclipse.org/cosmos/TestFedCMDB/3 | Passed | Passed | Passed | None. |
20c. COSMOS> GetSoapVersion http://www.eclipse.org/cosmos/examplemdr/4 | Passed | Passed | Passed | None. |
20d. COSMOS> GetSoapVersion http://www.eclipse.org/cosmos/smlmdr/5 | Passed | Passed | Passed | None. |
20e. COSMOS> GetSoapVersion http://www.eclipse.org/cosmos/aperimdr/6 | Passed | Passed | Passed | None. |
COSMOS Web User Interface
Test Description | Test Status
Windows XP SP2 |
Test Status
Windows 2003 SP1 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|---|
1.Layout of the User Interface | Passed | Passed | Passed | All 3 panes - DataManagers,Details and Properties are visible properly |
2.Data Managers View | Passed | Passed | Passed | Found All 6 DataManagers under COSMOS Web UI |
3.StatDataManager (Monitoring Data Repository)
server 33 tomcat1181829221515 CBE -> Statistical Report |
Passed | Passed | Passed | Statistical Report generated successfully. Linux had a problem with backslash, fixed locally and passed |
3a.StatDataManager (Monitoring Data Repository)
StatDataManager -> Properties... |
Passed | Passed | Passed | Able to set security properties information |
4.LoggingDataManager (Logging Data Repository)
access_log.cbe.xml -> Top 10 Log Report |
Passed | Passed | Passed | Top 10 Log Report generated successfully.Linux had a problem with backslash, fixed locally and passed |
4a.LoggingDataManager (Logging Data Repository)
windows_app_log.cbe.xml -> Top 10 Log Report |
Passed | Passed | Passed | Top 10 Log Report generated successfully.Linux had a problem with backslash, fixed locally and passed |
4b.LoggingDataManager (Logging Data Repository)
LoggingDataManager -> Properties... |
Passed | Passed | Passed | Able to set security information properly |
5.Resource Repository (SML MDR)
Resoure Repository->All Computer Systems |
Passed | Passed | Passed | Pre-defined CMDBf query for All Computer systems, executed successfully |
5a.Resource Repository (SML MDR)
Resoure Repository->All Operating Systems |
Passed | Passed | Passed | Pre-defined CMDBf query for All Operating systems, executed successfully |
5b.Resource Repository (SML MDR)
Resoure Repository->Operating System of Computer |
Passed | Passed | Passed | Pre-defined CMDBf query for 'Operating System of Computer', executed successfully |
5c.Resource Repository (SML MDR)
Resoure Repository->New Folder... |
Passed | Passed | Passed | Able to create new folder |
5d.Resource Repository (SML MDR)
Resoure Repository->Submit Query as Text |
Passed | Passed | Passed | Able to execute CMDBf queries successfully |
5e.Resource Repository (SML MDR)
Resoure Repository->New Folder...->Delete |
Passed | Passed | Passed | Able to Delete custom folder successfully |
5f.Resource Repository (SML MDR)
Resoure Repository->View MetaData |
Passed | Passed | Passed | Able to see appropriate metadata information - No Metadata available |
5g.Resource Repository (SML MDR)
Resource Repository->Properties |
Passed | Passed | Passed | Able to set security properties properly |
5h.Resource Repository (SML MDR)
Resource Repository->New Folder->New Folder... |
Passed | Passed | Passed | Able to create subfolder under existing folder |
5i.Resource Repository (SML MDR)
Resource Repository->CMDBf Query..->Open With>>->Tabular View |
Passed | Passed | Passed | Able to see CMDBf response data as Tabular view |
5j.Resource Repository (SML MDR)
Resource Repository->CMDBf Query..->Open With>>->Hierarchal View |
Passed | Passed | Passed | Able to view Hierarchial view of CMDBf data |
5k.Resource Repository (SML MDR)
Resource Repository->CMDBf Query..->Register Configuration Items... |
Passed | Passed | Passed | Partial registration works fine |
5l.Resource Repository (SML MDR)
Resource Repository->CMDBf Query..->DeRegister Configuration Items... |
Passed | Passed | Passed | Partial deregistration works fine |
5m.Resource Repository (SML MDR)
Resource Repository->CMDBf Query..->Rename... |
Passed | Passed | Passed | Renaming Query or folder name works fine |
5n.Resource Repository (SML MDR)
Resource Repository->New Folder->CMDBf Query..->Rename... |
Passed | Passed | Passed | Renaming Query or folder under subfolder is working fine |
5o.Resource Repository (SML MDR)
Resource Repository->CMDBf Query..->Refresh |
Passed | Passed | Passed | Refresh works fine |
5p.Resource Repository (SML MDR)
Resource Repository->CMDBf Query..->Response History... |
Passed | Passed | Passed | Response History works fine with history data |
6.Sample Repository with Query (EXAMPLE MDR)
Get All Students |
Passed | Passed | Passed | Displayed Query Result for Students data correctly |
6a.Sample Repository with Query (EXAMPLE MDR)
Get All Teachers |
Passed | Passed | Passed | Displayed Query Result for Teachers data correctly |
6b.Sample Repository with Query (EXAMPLE MDR)
Get All Classes |
Passed | Passed | Passed | Displayed Query Result for Classes data correctly |
6c.Sample Repository with Query (EXAMPLE MDR)
Staff01 |
Passed | Passed | Passed | Displayed data for 'students taught by teacher-staff01' correctly. There is some problem with staff01, sometimes it doesn't get expanded. |
6d.Sample Repository with Query (EXAMPLE MDR)
Staff02 |
Passed | Passed | Passed | Displayed data for 'students taught by teacher-staff02' correctly. There is some problem with staff02, sometimes it doesn't get expaned. |
6e.Sample Repository with Query (EXAMPLE MDR)
Submit Query |
Passed | Passed | Passed | Using Query Builder, able to create and execute queries correctly. There is some problem with relationship queries, where it's not showing result correctly |
6f.Sample Repository with Query (EXAMPLE MDR)
Submit Query as Text |
Passed | Passed | Passed | Able to execute CMDBf queries successfully |
6g.Sample Repository with Query (EXAMPLE MDR)
View MetaData |
Passed | Passed | Passed | Displayed MetaData information correctly |
6h.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->Properties |
Passed | Passed | Passed | Able to set Security information correctly |
6i.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->New Folder... |
Passed | Passed | Passed | Able to create New Folder correctly |
6j.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->New Folder->New Folder... |
Passed | Passed | Passed | Able to create Sub Folder under existing folder correctly |
6k.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->CMDBf Query..->Open With>>->Tabular View |
Passed | Passed | Passed | Able to see tabular view of CMDBf query result data correctly, Having some problem with IE |
6l.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->CMDBf Query..->Open With>>->Hierarchal View |
Passed | Passed | Passed | Able to see Hierarchial view of CMDBf query result data correctly |
6m.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->CMDBf Query..->Register Configuration Items... |
Passed | Passed | Passed | Able to do partial registration correctly |
6n.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->CMDBf Query..->DeRegister Configuration Items... |
Passed | Passed | Passed | Able to do partial deregistration correctly |
6o.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->CMDBf Query..->Rename... |
Passed | Passed | Passed | Able to Rename Query or folder name correctly |
6p.Sample Repository with Query (EXAMPLE MDR)
Sample Repository with Query->New Folder->CMDBf Query...->Rename... |
Passed | Passed | Passed | Able to Rename Query or folder under existing folder |
6q.Sample Repository with Query (EXAMPLE MDR)
Sample Reposotiry with Query->CMDBf Query..->Refresh |
Passed | Passed | Passed | CMDBf Query refresh works fine |
6r.Sample Repository with Query (EXAMPLE MDR)
Sample Reposotiry with Query->CMDBf Query..->Response History... |
Passed | Passed | Passed | Response history works fine with history data |
6s.Sample Repository with Query (EXAMPLE MDR)
Sample Reposotiry with Query->New Folder...->Delete |
Passed | Passed | Passed | Able to delete folder successfully |
7.Sample Repository with Registration (Federating CMDB)
All Items and Relationships |
Passed | Passed | Passed | Pre-defined Query - All Items and Relationships executed successfully |
7a.Sample Repository with Registration (Federating CMDB)
Submit Query as Text |
Passed | Passed | Passed | Able to run CMDBf queries successfully (same as Submit Query as Text) |
7b.Sample Repository with Registration (Federating CMDB)
Register Configuration Items...->select "Sample Repository with Query" |
Passed | Passed | Passed | Full Registration with Example MDR is successful |
7c.Sample Repository with Registration (Federating CMDB)
Register Configuration Items...->select "Resource Repository" |
Passed | Passed | Passed | Full Registration with SML MDR is successful |
7d.Sample Repository with Registration (Federating CMDB)
Register Configuration Items...->select "Storage Repository" |
Failed | Failed | Failed | Full Registration with AperiMdr - Failed (No response on UI) |
7e.Sample Repository with Registration (Federating CMDB)
Deregister Configuration Items...->select "Sample Repository with Query" |
Passed | Passed | Passed | Full Deregistration with Example MDR is successful |
7f.Sample Repository with Registration (Federating CMDB)
Deregister Configuration Items...->select "Resource Repository" |
Passed | Passed | Passed | Full Deregistration with SML MDR is successful |
7g.Sample Repository with Registration (Federating CMDB)
Deregister Configuration Items...->select "Storage Repository" |
Failed | Failed | Failed | Full Deregistration with Aperi MDR - Failed |
7h.Sample Repository with Registration (Federating CMDB)
register Configuration Items...->select "Sample Repository with Query" and "Resource Repository" |
Passed | Passed | Passed | Full registration with Example Mdr and SML Mdr - Passed |
7i.Sample Repository with Registration (Federating CMDB)
Deregister Configuration Items...->select "Sample Repository with Query" and "Resource Repository" |
Passed | Passed | Passed | Full deregistration with Example Mdr and SML Mdr - Passed |
7j.Sample Repository with Registration (Federating CMDB)
New Folder... |
Passed | Passed | Passed | Able to create New Folder successfully |
7k.Sample Repository with Registration (Federating CMDB)
CMDBf Query..->Rename... |
Passed | Passed | Passed | Able to rename Query/Folder successfully |
7l.Sample Repository with Registration (Federating CMDB)
Properties... |
Passed | Passed | Passed | Able to set Security Information correctly |
7m.Sample Repository with Registration (Federating CMDB)
CMDBf Query..->Open With>>->Tabular View |
Passed | Passed | Passed | Able to view CMDBf query result under Tabular view properly (IE is having some problem) |
7n.Sample Repository with Registration (Federating CMDB)
CMDBf Query..->Open With>>->Hierarchial View |
Passed | Passed | Passed | Hierarchial View of CMDBf result data working properly |
7o.Sample Repository with Registration (Federating CMDB)
CMDBf Query..->Refresh |
Passed | Passed | Passed | CMDBf Query refresh is working fine |
7p.Sample Repository with Registration (Federating CMDB)
View MetaData |
Passed | Passed | Passed | Able to view appropriate message for View MetaData |
7q.Sample Repository with Registration (Federating CMDB)
Response History... |
Passed | Passed | Passed | Able to view Response Histories with last queried data |
7q.Sample Repository with Registration (Federating CMDB)
New Folder...->delete |
Passed | Passed | Passed | Able to delete folder successfully |
8a.AperiMDR (Storage Repository)
New Folder... |
Passed | Passed | Passed | None |
8b.AperiMDR (Storage Repository)
Submit Query |
Passed | Passed | Passed | Using Query builder able to execute and validate queries properly |
8c.AperiMDR (Storage Repository)
Submit Query as Text |
Passed | Passed | Passed | Able to execute CMDBf queries correctly |
8d.AperiMDR (Storage Repository)
View MetaData |
Passed | Passed | Passed | Displayed MetaData properly |
8e.AperiMDR (Storage Repository)
Properties... |
Passed | Passed | Passed | Able to set security properties properly |
8f.AperiMDR (Storage Repository)
CMDBf Query->Open With >>->Tabular View |
Passed | Passed | Passed | Able to view Tabular View of CMDBf query response data |
8g.AperiMDR (Storage Repository)
CMDBf Query->Open With >>->Hierarchial View |
Passed | Passed | Passed | Able to view Hierarchial View of CMDBf query response data |
8h.AperiMDR (Storage Repository)
CMDBf Query->Register Configuration Items... |
Passed | Passed | Passed | Partial registration with FederatingCMDB works fine |
8i.AperiMDR (Storage Repository)
CMDBf Query->DeRegister Configuration Items... |
Passed | Passed | Passed | Partial Deregistration with FederatingCMDB works fine |
8k.AperiMDR (Storage Repository)
CMDBf Query->Rename... |
Passed | Passed | Passed | Renaming Query or folder names works fine |
8l.AperiMDR (Storage Repository)
New Folder->CMDBf Query->Rename... |
Passed | Passed | Passed | Renaming Query or folder names under subfolder - Works fine |
8m.AperiMDR (Storage Repository)
CMDBf Query->Refresh |
Passed | Passed | Passed | CMDBf query refresh work fine |
8n.AperiMDR (Storage Repository)
CMDBf Query->Response History... |
Passed | Passed | Passed | Response History is working fine |
8o.AperiMDR (Storage Repository)
New Folder...->delete |
Passed | Passed | Passed | Able to delete query/folder successfully |
9.Full screen mode toolbar button
|
Passed | Passed | Passed | Able to view all(DataMangers/Properties/Details) panes in fullscreen mode correctly |
10.CMDB Graph Response Report
|
Passed | Passed | Passed | Able to view CMDB Graph Response reports for all CMDBf queris. There is a minor issue (backslash usage or reportDeployment.xml) under linux, resolved locally and tested. |
Data Visualization TPTP Manual Tests Execution
Eclipse tooling tests - MDR toolkit and SML Tooling (UI tests)
Execution of i14 supplement e2e tests (negative) from QA.
i14 ERs – JUnits/Manual Tests inspection
Basic operational efficiency tests (limited performance tests)
Configuration Tests
Test Description | Test Status | Remarks |
---|---|---|
1.Testing the scenario where COSMOSUI,COSMOSReportViewer running on windows PC1,broker running on windows PC2 and all datamanagers running on linux PC1
<cosmos-demo>/cosmosClient/bin/cosmosClient.bat http://<WindowsPC2host>:8080/axis2/services/Broker COMSOS>RegisterAllDataManagers http://<linuxPC1host:8080>/axis2/services/CosmosServiceFinder
|
Passed | COSMOS UI works fine with this setup. |
2.Testing the scenario where COSMOSUI running on windows and all COSMOS services running on Linux
|
Passed | COSMOS UI works fine with this setup. |
Concurrency Tests
Test Description | Test Status | Remarks |
---|---|---|
1.Concurrency tests, where multiple COSMOSUI's running on one machine
|
Passed | None |
2.Concurrency tests, where multiple COSMOSUI's and multiple COSMOS Command Line Clients running on one machine
|
Passed | None |
Volume/Performance Tests
- Refer http://wiki.eclipse.org/COSMOS_Performance_Testing#Performance_Tests
- Refer http://wiki.eclipse.org/COSMOS_Performance_Testing#Scalability_Tests