Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "COSMOS i9 QA Phase Execution"
(New page: This page created per the request from QA. This page will be filled in by the QA team as i9 testing phase proceeds.) |
(→Basic Operational efficiency tests) |
||
(66 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
− | This page created per the request from QA. This page will be filled in by the QA team as i9 testing phase proceeds. | + | This page created per the request from QA to track all i9 test execution activities from 25 Feb'08 to 07 Mar'08. This page will be filled in by the QA team as i9 testing phase proceeds. |
+ | |||
+ | ==QA Test Execution Activities for i9 == | ||
+ | |||
+ | '''Primary Tasks:''' | ||
+ | # E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0 (http://wiki.eclipse.org/COSMOS_DEMO_i9 ) | ||
+ | # i9 ERs (17 ERs) – JUnits/Manual Tests inspection (http://wiki.eclipse.org/Cosmos1.0Features#Iteration_9_Enhancements) | ||
+ | # Data Visualization TPTP Manual Tests Execution (DataVisualization.UI.Component.Widget.testsuite / UI.Reports.testsuite) | ||
+ | |||
+ | '''Secondary Tasks:''' | ||
+ | # Execution of i9 supplement e2e tests from QA. | ||
+ | # Basic operational efficiency tests (limited performance tests) | ||
+ | |||
+ | ==E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0) == | ||
+ | |||
+ | '''Build ID: COSMOS-1.0.0-200802261616 | ||
+ | http://www.eclipse.org/cosmos/downloads/?buildId=COSMOS-1.0.0-200802261616''' | ||
+ | |||
+ | Last updated : --[[User:Domsr01.ca.com|Domsr01.ca.com]] 07:21, 29 February 2008 (EST) | ||
+ | |||
+ | {|{{BMTableStyle}} | ||
+ | |-{{BMTHStyle}} | ||
+ | ! Test Description | ||
+ | ! Test Status | ||
+ | Windows XP SP2 | ||
+ | ! Test Status | ||
+ | Windows 2003 SP1 | ||
+ | ! Test Status | ||
+ | RHES 5.0 | ||
+ | ! Remarks | ||
+ | |- | ||
+ | |'''Build Installation and Configuration''' | ||
+ | <cosmos-demo>/bin/configDemo.bat | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |None | ||
+ | |- | ||
+ | |'''Starting COSMOS components''' | ||
+ | <tomcat-install-dir>/bin/startup.bat | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |All 5 Data Managers started successfully | ||
+ | |- | ||
+ | |'''Get Brokers registered at Management Domain''' | ||
+ | COSMOS> domain getBrokers | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Listed Broker EPR successfully | ||
+ | |- | ||
+ | |'''Get Data Managers register at the Broker''' | ||
+ | COSMOS> broker getDataManagers | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Listed All 5 Data Managers EPRs | ||
+ | |- | ||
+ | |'''CMDBf Query Execution''' | ||
+ | COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testInstanceIdQuery.txt | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Query Executed Successfully | ||
+ | |- | ||
+ | |COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testPropertyQuery.txt | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Query Executed Successfully | ||
+ | |- | ||
+ | |COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-students.txt | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Query Executed Successfully | ||
+ | |- | ||
+ | |COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-teachers.txt | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Query Executed Successfully | ||
+ | |- | ||
+ | |COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\relationship-all- | ||
+ | classes.txt | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Query Executed Successfully | ||
+ | |- | ||
+ | |COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\teaches-relationship.txt | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Query Executed Successfully | ||
+ | |- | ||
+ | |COSMOS>examplemdr getWSD | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Displayed WSDL information from Example MDR | ||
+ | |- | ||
+ | |'''Data Manager Services : Collecting Log Events from Logging Data Manager''' | ||
+ | logging getDatasets | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Listed 2 DataSources successfully | ||
+ | |- | ||
+ | |logging getAllCBE access_log.cbe.xml | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Diplayed long list of CommonBaseEvent objects obtained from the logfile specified | ||
+ | |- | ||
+ | |logging getCBECountBySeverity access_log.cbe.xml | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Displayed event type summary from the logfile specified | ||
+ | |- | ||
+ | |logging getAllCBE windows_app_log.cbe.xml | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Diplayed long list of CommonBaseEvent objects obtained from the logfile specified | ||
+ | |- | ||
+ | |logging getCBECountBySeverity access_log.cbe.xml | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Displayed event type summary from the logfile specified | ||
+ | |- | ||
+ | |'''Data Manager Services : Collect webserver performance data from Statistical Data Manager''' | ||
+ | stat getDatasourceKeyset | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Displayed dataset/keyset combinations available | ||
+ | |- | ||
+ | |stat getStatDataForSource "server 33 tomcat1181829221515" CBE | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Displayed formatted output for the given dataset/keyset | ||
+ | |- | ||
+ | |stat getStatDataForSource "server 33 tomcat1181829221515" TomcatSet | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Displayed formatted output for the given dataset/keyset | ||
+ | |- | ||
+ | |'''COSMOS Web User Interface tests (should be verified on both IE and Firefox)''' | ||
+ | Open http://localhost:8080/COSMOSUI/?page=cosmos (shd display 5 Data Managers nodes) | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Displayed 5 Data Manager nodes (Statistical,SML MDR,Example MDR,Registration Example,CBE) successfully | ||
+ | |- | ||
+ | |Expand Statistical node and check for Dataset/Keyset values | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Diplayed 2 Dataset/keyset values successfully | ||
+ | |- | ||
+ | |Expand CBE node and check for 2 log files | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Diplayed 2 log file names successfully | ||
+ | |- | ||
+ | |Verify the properties of all 5 nodes under Properties pane | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |All properties values are rendering properly | ||
+ | |- | ||
+ | |Using SMLMDR and verify CMDBf response viewer | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |All existing SMLMDR CMDBf queries executed properly | ||
+ | |- | ||
+ | |Using EXAMPLE MDR Query Builder and verifying CMDBf response viewer | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Query Builded successfully and displayed all data properly under CMDBf Response Viewer | ||
+ | |- | ||
+ | |'''RegistrationExample ''' | ||
+ | Registering configuration items with the test Federating CMDB | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Registered configured items successfully | ||
+ | |- | ||
+ | |Deregistering configuration items with the test Federating CMDB | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Deregistered configured items successfully | ||
+ | |- | ||
+ | |Generate Top 10 Log reports for CBE of access_log.cbe.xml | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Generated Top 10 Log reports for access_log_cbe.xml successfully | ||
+ | |- | ||
+ | |Generate Top 10 Log reports for CBE of windows_app_log.cbe.xml | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Generated Top 10 Log reports for windows_app_log.cbe.xml file successfully | ||
+ | |- | ||
+ | |Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" CBE | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Generated Stat report for given CBE dataset/keyset values successfully | ||
+ | |- | ||
+ | |Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" TomcatSet | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Generated Stat report for given TomcatSet dataset/keyset values successfully | ||
+ | |} | ||
+ | |||
+ | ==i9 ERs - JUnits/Manual Tests Inspection == | ||
+ | |||
+ | [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=Technology&product=Cosmos&version=1.0&target_milestone=1.0i9&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_severity=enhancement&emailtype1=substring&email1=&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= (Bugzilla: i9 Enhancements)] | ||
+ | |||
+ | |||
+ | {|{{BMTableStyle}} | ||
+ | |-{{BMTHStyle}} | ||
+ | ! Bugzilla ID | ||
+ | ! ID Summary | ||
+ | ! JUnits Status | ||
+ | ! Manual Tests | ||
+ | ! Remarks | ||
+ | |- | ||
+ | |||
+ | |216210 | ||
+ | |Define & document COSMOS 1.0 hardware & software operational guidelines, recommendations, and best practices | ||
+ | |NA | ||
+ | |NA | ||
+ | |This ER refers to documentation | ||
+ | |- | ||
+ | |215123 | ||
+ | |Complete CMDBf 1.0 Service Metadata implementation | ||
+ | |NA | ||
+ | |Available | ||
+ | |Manual Tests available under Design Doc. | ||
+ | |- | ||
+ | |214672 | ||
+ | |Registration of MDR configuration items with a federating CMDB | ||
+ | |NA | ||
+ | |NA | ||
+ | |No explicit Manual Tests/JUnits available. Found some tests on End2End demo page and under Data Visualization TPTP Manual tests | ||
+ | |- | ||
+ | |216211 | ||
+ | |We need an ongoing build process to facilitate a continuous test loop | ||
+ | |NA | ||
+ | |NA | ||
+ | |This ER refers to Documentation | ||
+ | |- | ||
+ | |205826 | ||
+ | |Update DataCenter model based on latest SML changes | ||
+ | |NA | ||
+ | |NA | ||
+ | |This ER refers to Documentation | ||
+ | |- | ||
+ | |217301 | ||
+ | |Visualizing a CMDBf status response | ||
+ | |NA | ||
+ | |NA | ||
+ | |No explicit Manual Tests/JUnits available. Found some tests on End2End demo page and under Data Visualization TPTP Manual tests | ||
+ | |- | ||
+ | |214794 | ||
+ | |"Generic" metadata driven CMDBf Query Builder | ||
+ | |Available | ||
+ | |Available | ||
+ | |Manual Tests & JUnits available (JUnits CVS path is missing) | ||
+ | |- | ||
+ | |217337 | ||
+ | |Generate JSON outputter for generic CMDBf Graph Response View | ||
+ | |NA | ||
+ | |Available | ||
+ | |Manual Tests available under Design Doc | ||
+ | |- | ||
+ | |208274 | ||
+ | |Create a data manager toolkit that will allow adopters to easily register and use a data provider inside COSMOS framework | ||
+ | |NA | ||
+ | |Available | ||
+ | |Manual TPTP tests available under CVS | ||
+ | |- | ||
+ | |215267 | ||
+ | |Provide support for adding a federating CMDB to COSMOS framework | ||
+ | |NA | ||
+ | |NA | ||
+ | |No explicit Manual Tests/JUnits available. Found some tests on End2End demo page and under Data Visualization TPTP Manual tests | ||
+ | |- | ||
+ | |214145 | ||
+ | |Generic CMDBf Graph Response View | ||
+ | |NA | ||
+ | |Available | ||
+ | |Manual Tests available under Design Doc | ||
+ | |- | ||
+ | |209980 | ||
+ | |MDR (and Data Manager) deployment outside of OSGi environment | ||
+ | |NA | ||
+ | |NA | ||
+ | |No explicit Manual Tests/Junits available, however these tests have been covered under End2End testing demo page | ||
+ | |- | ||
+ | |214903 | ||
+ | |Provide a mechanism for testing the registration service and client | ||
+ | |NA | ||
+ | |NA | ||
+ | |No explicit Manual Tests/JUnits available. Found some tests on End2End demo page and under Data Visualization TPTP Manual tests | ||
+ | |- | ||
+ | |216529 | ||
+ | |Define scope and detail the i9 QA activities | ||
+ | |NA | ||
+ | |NA | ||
+ | |This ER refers to Documentation | ||
+ | |- | ||
+ | |220181 | ||
+ | |Complete the i9 QA activities | ||
+ | |NA | ||
+ | |NA | ||
+ | |This ER refers to Documentation | ||
+ | |- | ||
+ | |205825 | ||
+ | |Update SML validator implementation based on changes to the SML latest draft | ||
+ | |NA | ||
+ | |NA | ||
+ | |This ER referes to SML-IF Documentation | ||
+ | |} | ||
+ | |||
+ | ==i9 End2End Supplement Tests == | ||
+ | |||
+ | '''Build ID: COSMOS-1.0.0-200802261616 | ||
+ | http://www.eclipse.org/cosmos/downloads/?buildId=COSMOS-1.0.0-200802261616''' | ||
+ | |||
+ | {|{{BMTableStyle}} | ||
+ | |-{{BMTHStyle}} | ||
+ | ! Test Description | ||
+ | ! Test Status | ||
+ | Windows XP SP2 | ||
+ | ! Test Status | ||
+ | RHES 5.0 | ||
+ | ! Remarks | ||
+ | |- | ||
+ | |'''Starting COSMOS Components''' | ||
+ | #Unzip COSMOS demo zip file and copy all folders from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with port 8090 (other than default 8080) | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #All COSMOS Components should start successfully | ||
+ | |Failed | ||
+ | |Failed | ||
+ | |No Data Managers are getting registered to port 8090 | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with default port 8080, hostname other than localhost | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #All COSMOS Components should start successfully | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |None | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with spaces in paths of tomcat-dir and cosmos-dir | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #All COSMOS Components should start successfully and all operations should work normally | ||
+ | |Failed | ||
+ | |Not Tested | ||
+ | |SML MDR is not working and throwing exception | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with invalid configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #No Data Managers should get registered, due to invalid domain EPR | ||
+ | #COSMOS UI Should through Error message for invalid domain EPR | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |None | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (except log,stat) from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #Except logging and stat Datamanager, remaining COSMOS components should start successfully | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |ConfigDemo.bat is throwing error messages for non-existance of logging and stat data managers | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (except cosmos) from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #No COSMOS components should get started, as there is no domain and broker running | ||
+ | #COSMOS UI should throw an error with connection refused | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |None | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (except COSMOSUI) from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #All COSMOS components should get started except COSMOSUI | ||
+ | #All COSMOS command line operations should work normally | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |None | ||
+ | |- | ||
+ | |'''COSMOS Command Line Operations - CMDBf Queries''' | ||
+ | #Unzip COSMOS demo zip file and copy all folders (except smlmdr) from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #run 'examplemdr query <valid-query-path>' with valid SML EPR as input | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #Error occurred while executing CMDBf query. | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Found some fatal error, along with expected error ([Fatal Error] :1:1145: The element type "HR" must be terminated by the matching end-tag "</HR>".) | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (except smlmdr) from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #run 'examplemdr query <valid-query-path>' with Example EPR as input | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #Should get an empty Query response, as it's point to wrong repository | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Query response: | ||
+ | <?xml version="1.0" encoding="UTF-8"?><dyn:graphQueryResponseType xmlns:dyn="htt | ||
+ | p://www.eclipse.org/cosmos/mdrquery" xmlns:cmdbf="http://cmdbf.org/schema/1-0-0/ | ||
+ | datamodel"/> | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (except examplemdr) from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #run 'smlmdr query <valid-query-path>' with valid Example EPR as input | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #Error occurred while executing CMDBf query. | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Found some fatal error, along with expected error ([Fatal Error] :1:1145: The element type "HR" must be terminated by the matching end-tag "</HR>".) | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (except examplemdr) from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #run 'smlmdr query <valid-query-path>' with SML EPR as input | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #Should get an empty Query response, as it's pointing to wrong repository | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Query response: | ||
+ | <?xml version="1.0" encoding="UTF-8"?><dyn:graphQueryResponseType xmlns:dyn="htt | ||
+ | p://www.eclipse.org/cosmos/mdrquery" xmlns:cmdbf="http://cmdbf.org/schema/1-0-0/ | ||
+ | datamodel"/> | ||
+ | |- | ||
+ | |'''COSMOS Command Line Operations - Data Manager Services''' | ||
+ | #Unzip COSMOS demo zip file and copy all folders (except logging) from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #run 'logging getDatasets' with valid Log Datamanager EPR as input | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #No datasets were returned. | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |output:[Fatal Error] :1:1163: The element type "HR" must be terminated by the matching | ||
+ | end-tag "</HR>". | ||
+ | Request failed. | ||
+ | No datasets were returned. | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (including logging) from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #run 'logging getDatasets' with valid Log Datamanager EPR as input | ||
+ | #run 'logging getAllCBE <invalid-logfile>' | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #Request failed. | ||
+ | No CBEs were returned. | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |None | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (including logging) from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #run 'logging getDatasets' with valid Log Datamanager EPR as input | ||
+ | #run 'logging getCBECountBySeverity <invalid-logfile>' | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #Request failed. | ||
+ | No CBEs were returned. | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Found cosmos exception along with expected output | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (except stat) from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #run 'stat getDatasourceKeyset' with valid Stat Datamanager EPR as input | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #Request failed. | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |output: [Fatal Error] :1:1157: The element type "HR" must be terminated by the matching | ||
+ | end-tag "</HR>". | ||
+ | Request failed. | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (including stat) from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #run 'stat getDatasourceKeyset' with valid Stat Datamanager EPR as input | ||
+ | #run 'stat getStatDataForSource <invalid-datasource> CBE' | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #No output, blank line | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |None | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (including stat) from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #run 'stat getDatasourceKeyset' with valid Stat Datamanager EPR as input | ||
+ | #run 'stat getStatDataForSource <valid-datasource> <invalid keyset>' | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #No output, blank line | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |None | ||
+ | |- | ||
+ | |'''COSMOS Web User Interface''' | ||
+ | #Unzip COSMOS demo zip file and copy all folders (except examplemdr) from <cosmos-demo>/webapps into <tomcat-dir>/webapps (don't cleanup previous data cache, where all components are running) | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #Open COSMOS UI,http://localhost:8080/COSMOSUI/?page=cosmos | ||
+ | #Try to Build valid CMDBf query on ExampleMDR | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #Should get connection refused error, as Example MDR is not up and running | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |found exception : org.apache.muse.ws.addressing.soap.SoapFault: The element type "HR" must be terminated by the matching end-tag "". | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (including examplemdr) from <cosmos-demo>/webapps into <tomcat-dir>/webapps (don't cleanup previous data cache, where all components are running) | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #Open COSMOS UI,http://localhost:8080/COSMOSUI/?page=cosmos | ||
+ | #Build invalid CMDBf query on ExampleMDR | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #Should get empty CMDBf Graph Response view | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |None | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (except smlmdr) from <cosmos-demo>/webapps into <tomcat-dir>/webapps (don't cleanup previous data cache, where all components are running) | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #Open COSMOS UI,http://localhost:8080/COSMOSUI/?page=cosmos | ||
+ | #run valid existing CMDBf query on SMLMDR | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #Should get connection refused error, as SML MDR is not up and running | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |Found exception : org.apache.muse.ws.addressing.soap.SoapFault: The element type "HR" must be terminated by the matching end-tag "". | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (including smlmdr) from <cosmos-demo>/webapps into <tomcat-dir>/webapps (don't cleanup previous data cache, where all components are running) | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #Open COSMOS UI,http://localhost:8080/COSMOSUI/?page=cosmos | ||
+ | #run invalid CMDBf query on SMLMDR | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #Should get empty CMDBf Graph Response view | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |None | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (except log) from <cosmos-demo>/webapps into <tomcat-dir>/webapps (don't cleanup previous data cache, where all components are running) | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #Open COSMOS UI,http://localhost:8080/COSMOSUI/?page=cosmos | ||
+ | #Go to CBE node and try to expand the node to get the list of log files | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #CBE node should not expand as logging data manager is not up and running | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |No error message on GUI but exceptions found on tomcat console window | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (except stat) from <cosmos-demo>/webapps into <tomcat-dir>/webapps (don't cleanup previous data cache, where all components are running) | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #Open COSMOS UI,http://localhost:8080/COSMOSUI/?page=cosmos | ||
+ | #Go to Statistical node and try to expand the node to get the list of Dataset/Keyset pairs | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #Statistical Data Manager node, should not expand as stat manager is not up and running | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |No error message on GUI but exceptions found on tomcat console window | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (except testFederatingCMDB) from <cosmos-demo>/webapps into <tomcat-dir>/webapps (don't cleanup previous data cache, where all components are running) | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #Open COSMOS UI,http://localhost:8080/COSMOSUI/?page=cosmos | ||
+ | #Go to 'Registration Example' node and try to register/deregister examplemdr node | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #It should throw connection refused message, as 'Registration Example' data manager is not up and runing | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |It's showing register/deregister popup window and then when if we try to register it throws the exception | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders (except Example MDR) from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #Open COSMOS UI,http://localhost:8080/COSMOSUI/?page=cosmos | ||
+ | #Right click on 'Registration Example' and try to register 'Example MDR' | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #It should not list 'Example MDR' under it's 'Register MDR Configuratin Items' dialog window | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |None | ||
+ | |- | ||
+ | | | ||
+ | #Unzip COSMOS demo zip file and copy all folders from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #Open COSMOS UI,http://localhost:8080/COSMOSUI/?page=cosmos | ||
+ | #Right click on 'Example Registration' and try to register 'SML MDR' | ||
+ | #Right click on 'Example Registration' and try to deregister 'SML MDR' | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | #Registration results should be empty under 'Register MDR Configuration items' window | ||
+ | #Deregistration should be successful and it show deregistration results | ||
+ | |Passed | ||
+ | |Passed | ||
+ | |None | ||
+ | |} | ||
+ | |||
+ | ==Basic Operational efficiency tests == | ||
+ | |||
+ | {|{{BMTableStyle}} | ||
+ | |-{{BMTHStyle}} | ||
+ | ! Test Description | ||
+ | ! Output | ||
+ | ! Status | ||
+ | ! Remarks | ||
+ | |- | ||
+ | |||
+ | |'''Configuration Tests''' | ||
+ | '''Scenario1 : Management Domain and Broker running on Windows, Data Managers running on Linux''' | ||
+ | |||
+ | ''On Windows'' | ||
+ | #Unzip COSMOS demo zip file and copy only cosmos and COSMOSUI folders from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #Open COSMOS UI (http://localhost:8080/COSMOSUI/?page=cosmos) and make sure it does not display any data managers | ||
+ | |||
+ | ''On Linux'' | ||
+ | #Unzip COSMOS demo zip file and copy all folders from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with hostname and port pointing to windows domain | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) (All Data Managers should now get registered to windows Domain) | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | # COSMOS UI on windows should now show all Linux Data Managers and all operations over them should function normally | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |- | ||
+ | |'''Scenario2 : Data Managers running on Windows, Management Domain and Broker running on Linux''' | ||
+ | |||
+ | ''On Linux'' | ||
+ | #Unzip COSMOS demo zip file and copy only cosmos and COSMOSUI folders from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #Open COSMOS UI (http://localhost:8080/COSMOSUI/?page=cosmos) and make sure it does not display any data managers | ||
+ | |||
+ | ''On Windows'' | ||
+ | #Unzip COSMOS demo zip file and copy all folders from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with hostname and port pointing to Linux Domain | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat)(All Data Managers should now get registered to Linux Domain) | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | # COSMOS UI on Linux should now show all Windows Data Managers and all operations over them should function normally | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |- | ||
+ | |'''Concurrency Tests''' | ||
+ | '''Scenario1 : 2 COSMOS Command line clients/ COSMOS UI's running on same machine''' | ||
+ | |||
+ | ''On Windows'' | ||
+ | #Unzip COSMOS demo zip file and copy all folders from <cosmos-demo>/webapps into <tomcat-dir>/webapps | ||
+ | #Run <cosmos-demo>/bin/ConfigDemo.bat with valid default configuration data | ||
+ | #Start tomcat (<tomcat-dir>/bin/startup.bat) | ||
+ | #Open <cosmos-demo>/cosmos-client/cosmosClient.sh (say 1st COSMOS client) | ||
+ | #Open another <cosmos-demo>/cosmos-client/cosmosClient.sh (say 2nd COSMOS Client) | ||
+ | |||
+ | ''Tests'' | ||
+ | #Query1 : Run 'smlmdr query <cosmos-demo>/<cosmos-client>/cmdbfQuery/SMLMDR/testInstanceIdQuery.txt' on both 1st and 2nd COSMOS clients simultenously | ||
+ | #Query2 : Run 'smlmdr query <cosmos-demo>/<cosmos-client>/cmdbfQuery/SMLMDR/testInstanceIdQuery.txt' on 1st COSMOS client and 'smlmdr query <cosmos-demo>/<cosmos-client>/cmdbfQuery/SMLMDR/cmdbfQuery/SMLMDR/testPropertyQuery.txt' on 2nd COSMOS client simultenously | ||
+ | #Query3 : Run 'smlmdr query <cosmos-demo>/<cosmos-client>/cmdbfQuery/SMLMDR/testInstanceIdQuery.txt' on 1st COSMOS client and 'examplemdr query <cosmos-demo>/cosmos-client/cmdbfQuery/ExampleMDR/all-students.txt' on 2nd COSMOS client simultenously | ||
+ | |||
+ | #Repeat above queries with 2 instances of COSMOS UI (one instance running on IE and another running on Firefox) | ||
+ | |||
+ | ''Expected Result:'' | ||
+ | # All Queries on COSMOS Command line shells should give correct results | ||
+ | # All Queries on COSMOS UIs should display accurate results | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |- | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |- | ||
+ | |'''Volume/Performance Tests''' | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |- | ||
+ | |'''Scalability/Stability Tests''' | ||
+ | | | ||
+ | | | ||
+ | |None | ||
+ | |} | ||
+ | |||
+ | ==i9 Test Execution Results == | ||
+ | |||
+ | --[[User:Domsr01.ca.com|Domsr01.ca.com]] 07:33, 29 February 2008 (EST) | ||
+ | '''COSMOS i9 E2E Tests''' | ||
+ | #COSMOS Command line Client, test results : | ||
+ | https://bugs.eclipse.org/bugs/attachment.cgi?id=90988 | ||
+ | https://bugs.eclipse.org/bugs/attachment.cgi?id=91166 | ||
+ | |||
+ | #COSMOS Web UI tests Snapshots : | ||
+ | https://bugs.eclipse.org/bugs/attachment.cgi?id=90987 | ||
+ | https://bugs.eclipse.org/bugs/attachment.cgi?id=91167 |
Latest revision as of 07:26, 7 March 2008
This page created per the request from QA to track all i9 test execution activities from 25 Feb'08 to 07 Mar'08. This page will be filled in by the QA team as i9 testing phase proceeds.
Contents
QA Test Execution Activities for i9
Primary Tasks:
- E2E testing on Windows XP, 2003 and Red Hat Enterprise Linux Server 5.0 (http://wiki.eclipse.org/COSMOS_DEMO_i9 )
- i9 ERs (17 ERs) – JUnits/Manual Tests inspection (http://wiki.eclipse.org/Cosmos1.0Features#Iteration_9_Enhancements)
- Data Visualization TPTP Manual Tests Execution (DataVisualization.UI.Component.Widget.testsuite / UI.Reports.testsuite)
Secondary Tasks:
- Execution of i9 supplement e2e tests from QA.
- Basic operational efficiency tests (limited performance tests)
E2E testing status (WinXP SP2/Win2K3 SP1/RHES 5.0)
Build ID: COSMOS-1.0.0-200802261616 http://www.eclipse.org/cosmos/downloads/?buildId=COSMOS-1.0.0-200802261616
Last updated : --Domsr01.ca.com 07:21, 29 February 2008 (EST)
Test Description | Test Status
Windows XP SP2 |
Test Status
Windows 2003 SP1 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|---|
Build Installation and Configuration
<cosmos-demo>/bin/configDemo.bat |
Passed | Passed | Passed | None |
Starting COSMOS components
<tomcat-install-dir>/bin/startup.bat |
Passed | Passed | Passed | All 5 Data Managers started successfully |
Get Brokers registered at Management Domain
COSMOS> domain getBrokers |
Passed | Passed | Passed | Listed Broker EPR successfully |
Get Data Managers register at the Broker
COSMOS> broker getDataManagers |
Passed | Passed | Passed | Listed All 5 Data Managers EPRs |
CMDBf Query Execution
COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testInstanceIdQuery.txt |
Passed | Passed | Passed | Query Executed Successfully |
COSMOS>smlmdr query <cosmos-demo>\cosmos-client\cmdbf-queries\SMLMDR\testPropertyQuery.txt | Passed | Passed | Passed | Query Executed Successfully |
COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-students.txt | Passed | Passed | Passed | Query Executed Successfully |
COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\all-teachers.txt | Passed | Passed | Passed | Query Executed Successfully |
COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\relationship-all-
classes.txt |
Passed | Passed | Passed | Query Executed Successfully |
COSMOS>examplemdr query <cosmos-demo>\cosmos-client\cmdbf-queries\ExampleMDR\teaches-relationship.txt | Passed | Passed | Passed | Query Executed Successfully |
COSMOS>examplemdr getWSD | Passed | Passed | Passed | Displayed WSDL information from Example MDR |
Data Manager Services : Collecting Log Events from Logging Data Manager
logging getDatasets |
Passed | Passed | Passed | Listed 2 DataSources successfully |
logging getAllCBE access_log.cbe.xml | Passed | Passed | Passed | Diplayed long list of CommonBaseEvent objects obtained from the logfile specified |
logging getCBECountBySeverity access_log.cbe.xml | Passed | Passed | Passed | Displayed event type summary from the logfile specified |
logging getAllCBE windows_app_log.cbe.xml | Passed | Passed | Passed | Diplayed long list of CommonBaseEvent objects obtained from the logfile specified |
logging getCBECountBySeverity access_log.cbe.xml | Passed | Passed | Passed | Displayed event type summary from the logfile specified |
Data Manager Services : Collect webserver performance data from Statistical Data Manager
stat getDatasourceKeyset |
Passed | Passed | Passed | Displayed dataset/keyset combinations available |
stat getStatDataForSource "server 33 tomcat1181829221515" CBE | Passed | Passed | Passed | Displayed formatted output for the given dataset/keyset |
stat getStatDataForSource "server 33 tomcat1181829221515" TomcatSet | Passed | Passed | Passed | Displayed formatted output for the given dataset/keyset |
COSMOS Web User Interface tests (should be verified on both IE and Firefox)
Open http://localhost:8080/COSMOSUI/?page=cosmos (shd display 5 Data Managers nodes) |
Passed | Passed | Passed | Displayed 5 Data Manager nodes (Statistical,SML MDR,Example MDR,Registration Example,CBE) successfully |
Expand Statistical node and check for Dataset/Keyset values | Passed | Passed | Passed | Diplayed 2 Dataset/keyset values successfully |
Expand CBE node and check for 2 log files | Passed | Passed | Passed | Diplayed 2 log file names successfully |
Verify the properties of all 5 nodes under Properties pane | Passed | Passed | Passed | All properties values are rendering properly |
Using SMLMDR and verify CMDBf response viewer | Passed | Passed | Passed | All existing SMLMDR CMDBf queries executed properly |
Using EXAMPLE MDR Query Builder and verifying CMDBf response viewer | Passed | Passed | Passed | Query Builded successfully and displayed all data properly under CMDBf Response Viewer |
RegistrationExample
Registering configuration items with the test Federating CMDB |
Passed | Passed | Passed | Registered configured items successfully |
Deregistering configuration items with the test Federating CMDB | Passed | Passed | Passed | Deregistered configured items successfully |
Generate Top 10 Log reports for CBE of access_log.cbe.xml | Passed | Passed | Passed | Generated Top 10 Log reports for access_log_cbe.xml successfully |
Generate Top 10 Log reports for CBE of windows_app_log.cbe.xml | Passed | Passed | Passed | Generated Top 10 Log reports for windows_app_log.cbe.xml file successfully |
Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" CBE | Passed | Passed | Passed | Generated Stat report for given CBE dataset/keyset values successfully |
Generate Statistical reports for Statistical node of "server 33 tomcat1181829221515" TomcatSet | Passed | Passed | Passed | Generated Stat report for given TomcatSet dataset/keyset values successfully |
i9 ERs - JUnits/Manual Tests Inspection
Bugzilla ID | ID Summary | JUnits Status | Manual Tests | Remarks |
---|---|---|---|---|
216210 | Define & document COSMOS 1.0 hardware & software operational guidelines, recommendations, and best practices | NA | NA | This ER refers to documentation |
215123 | Complete CMDBf 1.0 Service Metadata implementation | NA | Available | Manual Tests available under Design Doc. |
214672 | Registration of MDR configuration items with a federating CMDB | NA | NA | No explicit Manual Tests/JUnits available. Found some tests on End2End demo page and under Data Visualization TPTP Manual tests |
216211 | We need an ongoing build process to facilitate a continuous test loop | NA | NA | This ER refers to Documentation |
205826 | Update DataCenter model based on latest SML changes | NA | NA | This ER refers to Documentation |
217301 | Visualizing a CMDBf status response | NA | NA | No explicit Manual Tests/JUnits available. Found some tests on End2End demo page and under Data Visualization TPTP Manual tests |
214794 | "Generic" metadata driven CMDBf Query Builder | Available | Available | Manual Tests & JUnits available (JUnits CVS path is missing) |
217337 | Generate JSON outputter for generic CMDBf Graph Response View | NA | Available | Manual Tests available under Design Doc |
208274 | Create a data manager toolkit that will allow adopters to easily register and use a data provider inside COSMOS framework | NA | Available | Manual TPTP tests available under CVS |
215267 | Provide support for adding a federating CMDB to COSMOS framework | NA | NA | No explicit Manual Tests/JUnits available. Found some tests on End2End demo page and under Data Visualization TPTP Manual tests |
214145 | Generic CMDBf Graph Response View | NA | Available | Manual Tests available under Design Doc |
209980 | MDR (and Data Manager) deployment outside of OSGi environment | NA | NA | No explicit Manual Tests/Junits available, however these tests have been covered under End2End testing demo page |
214903 | Provide a mechanism for testing the registration service and client | NA | NA | No explicit Manual Tests/JUnits available. Found some tests on End2End demo page and under Data Visualization TPTP Manual tests |
216529 | Define scope and detail the i9 QA activities | NA | NA | This ER refers to Documentation |
220181 | Complete the i9 QA activities | NA | NA | This ER refers to Documentation |
205825 | Update SML validator implementation based on changes to the SML latest draft | NA | NA | This ER referes to SML-IF Documentation |
i9 End2End Supplement Tests
Build ID: COSMOS-1.0.0-200802261616 http://www.eclipse.org/cosmos/downloads/?buildId=COSMOS-1.0.0-200802261616
Test Description | Test Status
Windows XP SP2 |
Test Status
RHES 5.0 |
Remarks |
---|---|---|---|
Starting COSMOS Components
Expected Result:
|
Failed | Failed | No Data Managers are getting registered to port 8090 |
Expected Result:
|
Passed | Passed | None |
Expected Result:
|
Failed | Not Tested | SML MDR is not working and throwing exception |
Expected Result:
|
Passed | Passed | None |
Expected Result:
|
Passed | Passed | ConfigDemo.bat is throwing error messages for non-existance of logging and stat data managers |
Expected Result:
|
Passed | Passed | None |
Expected Result:
|
Passed | Passed | None |
COSMOS Command Line Operations - CMDBf Queries
Expected Result:
|
Passed | Passed | Found some fatal error, along with expected error ([Fatal Error] :1:1145: The element type "HR" must be terminated by the matching end-tag "</HR>".) |
Expected Result:
|
Passed | Passed | Query response:
<?xml version="1.0" encoding="UTF-8"?><dyn:graphQueryResponseType xmlns:dyn="htt p://www.eclipse.org/cosmos/mdrquery" xmlns:cmdbf="http://cmdbf.org/schema/1-0-0/ datamodel"/> |
Expected Result:
|
Passed | Passed | Found some fatal error, along with expected error ([Fatal Error] :1:1145: The element type "HR" must be terminated by the matching end-tag "</HR>".) |
Expected Result:
|
Passed | Passed | Query response:
<?xml version="1.0" encoding="UTF-8"?><dyn:graphQueryResponseType xmlns:dyn="htt p://www.eclipse.org/cosmos/mdrquery" xmlns:cmdbf="http://cmdbf.org/schema/1-0-0/ datamodel"/> |
COSMOS Command Line Operations - Data Manager Services
Expected Result:
|
Passed | Passed | output:[Fatal Error] :1:1163: The element type "HR" must be terminated by the matching
end-tag "</HR>". Request failed. No datasets were returned. |
Expected Result:
No CBEs were returned. |
Passed | Passed | None |
Expected Result:
No CBEs were returned. |
Passed | Passed | Found cosmos exception along with expected output |
Expected Result:
|
Passed | Passed | output: [Fatal Error] :1:1157: The element type "HR" must be terminated by the matching
end-tag "</HR>". Request failed. |
Expected Result:
|
Passed | Passed | None |
Expected Result:
|
Passed | Passed | None |
COSMOS Web User Interface
Expected Result:
|
Passed | Passed | found exception : org.apache.muse.ws.addressing.soap.SoapFault: The element type "HR" must be terminated by the matching end-tag "". |
Expected Result:
|
Passed | Passed | None |
Expected Result:
|
Passed | Passed | Found exception : org.apache.muse.ws.addressing.soap.SoapFault: The element type "HR" must be terminated by the matching end-tag "". |
Expected Result:
|
Passed | Passed | None |
Expected Result:
|
Passed | Passed | No error message on GUI but exceptions found on tomcat console window |
Expected Result:
|
Passed | Passed | No error message on GUI but exceptions found on tomcat console window |
Expected Result:
|
Passed | Passed | It's showing register/deregister popup window and then when if we try to register it throws the exception |
Expected Result:
|
Passed | Passed | None |
Expected Result:
|
Passed | Passed | None |
Basic Operational efficiency tests
Test Description | Output | Status | Remarks |
---|---|---|---|
Configuration Tests
Scenario1 : Management Domain and Broker running on Windows, Data Managers running on Linux On Windows
On Linux
Expected Result:
|
None | ||
Scenario2 : Data Managers running on Windows, Management Domain and Broker running on Linux
On Linux
On Windows
Expected Result:
|
None | ||
Concurrency Tests
Scenario1 : 2 COSMOS Command line clients/ COSMOS UI's running on same machine On Windows
Tests
Expected Result:
|
None | ||
None | |||
Volume/Performance Tests | None | ||
Scalability/Stability Tests | None |
i9 Test Execution Results
--Domsr01.ca.com 07:33, 29 February 2008 (EST) COSMOS i9 E2E Tests
- COSMOS Command line Client, test results :
https://bugs.eclipse.org/bugs/attachment.cgi?id=90988 https://bugs.eclipse.org/bugs/attachment.cgi?id=91166
- COSMOS Web UI tests Snapshots :
https://bugs.eclipse.org/bugs/attachment.cgi?id=90987 https://bugs.eclipse.org/bugs/attachment.cgi?id=91167