Skip to main content

Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

Difference between revisions of "TPTP Test Tools Project Tests"

(Manual)
(Manual)
 
(19 intermediate revisions by 2 users not shown)
Line 5: Line 5:
 
== Test Automation  ==
 
== Test Automation  ==
  
Over time, our goal is to automate as many of the manual tests as possible using the [http://www.eclipse.org/tptp/test/documents/gettingstarted/Automated_GUI_Recorder_Getting_Started.html TPTP Automated GUI Recorder (AGR)], the [http://abbot.sourceforge.net/doc/overview.shtml Abbot Java GUI Test Framework], or [http://www.eclipse.org/swtbot/ SWTBot] to reduce testing costs and improve quality through repeatable tests (for example, BVTs). The [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#Manual manual test suites] marked in <font color="red">red</font> are the next candidates for test automation.
+
Over time, our goal is to automate as many of the manual tests as possible using the [http://abbot.sourceforge.net/doc/overview.shtml Abbot Java GUI Test Framework] or [http://www.eclipse.org/swtbot/ SWTBot] to reduce testing costs and improve quality through repeatable tests (for example, BVTs). The [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#Manual manual test suites] marked in <font color="red">red</font> are the next candidates for test automation.
  
 
== Build Verification Test (BVT)  ==
 
== Build Verification Test (BVT)  ==
Line 46: Line 46:
 
**/org.eclipse.hyades.test.core.tests/junit_plugin/model/Test.Model.Datapool.Test.testsuite
 
**/org.eclipse.hyades.test.core.tests/junit_plugin/model/Test.Model.Datapool.Test.testsuite
 
**/org.eclipse.hyades.test.core.tests/junit_plugin/recorder/Test.Recorder.JNIWrapper.Test.testsuite
 
**/org.eclipse.hyades.test.core.tests/junit_plugin/recorder/Test.Recorder.JNIWrapper.Test.testsuite
 +
**/org.eclipse.hyades.test.core.tests/junit_plugin/util/Test.Util.JavaUtil.Test.testsuite
  
 
*Test Navigator tests:  
 
*Test Navigator tests:  
Line 53: Line 54:
 
**/org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestNavigatorProxyTest.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestNavigatorProxyTest.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestUIUtilTest.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestUIUtilTest.testsuite
 +
**/org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestUIUtilitiesTest.testsuite
  
 
*Datapool tests:  
 
*Datapool tests:  
Line 69: Line 71:
 
*ASF tests:  
 
*ASF tests:  
 
**/org.eclipse.hyades.test.core.services.tests/junit_plugin/Test.Execution.ServiceUtilTest.testsuite
 
**/org.eclipse.hyades.test.core.services.tests/junit_plugin/Test.Execution.ServiceUtilTest.testsuite
 
=== AGR  ===
 
 
*Test Navigator tests:
 
<!--
 
**/org.eclipse.hyades.test.ui.navigator.tests/gui/Test.UI.TestNavigator_Logical_auto.testsuite
 
-->
 
**/org.eclipse.hyades.test.ui.navigator.tests/gui/Test.UI.TestNavigator_Resource_auto.testsuite
 
 
*Datapool tests:
 
**/org.eclipse.hyades.test.ui.datapool.tests/gui/Test.UI.Datapool_Running.testsuite
 
 
*JUnit tests:
 
<!--
 
**/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM15_JUnitRunner.testsuite
 
**/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM16_JUnitRunner.testsuite
 
**/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun15_JUnitRunner.testsuite
 
**/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun16_JUnitRunner.testsuite
 
-->
 
**/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.JUnitRunner.Bug186196.testsuite
 
 
<!--
 
*Test Log View tests:
 
**/org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_linux.testsuite
 
**/org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_windows.testsuite
 
-->
 
  
 
== Test Pass 1 (<2 weeks) ==
 
== Test Pass 1 (<2 weeks) ==
Line 107: Line 83:
  
 
*Test Navigator tests:  
 
*Test Navigator tests:  
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_166025.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_166025.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_168055.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_168055.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_195203.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_195203.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_225157.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_225157.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_227769.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_231786.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_231786.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232070.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232070.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232089.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232089.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232310.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232310.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232397.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232397.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_235447.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_235447.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_235836.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_235836.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_236426.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_236426.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_241850.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_241850.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_242645.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_242645.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_242701.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_242701.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_243358.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_243358.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_243359.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_243359.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_245539.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_245539.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247185.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247185.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247987.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247987.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247989.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247989.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_248255.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_248255.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_248413.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_248413.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_249587.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_249587.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_250245.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_250245.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_250269.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_250269.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_253688.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_254459.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_254459.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_256362.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_256362.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_262150.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_262150.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_262402.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_262402.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263267.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263267.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263805.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263805.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263950.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263950.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_266728.testsuite
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_266728.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_274496.testsuite
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_273111.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_277525.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_274496.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_273111.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_277525.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_279986.testsuite  
+
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_284071.testsuite  
+
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_279986.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_279986.testsuite
 +
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_281249.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_282145.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_282145.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_282249.testsuite
 
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_282691.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_282691.testsuite
 +
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_284071.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_287472.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_287472.testsuite
 +
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_293559.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_294795.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_294795.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_295877.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_295877.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_296157.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_296157.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_299137.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_299137.testsuite
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_293559.testsuite
 
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_304974.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_304974.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_307969.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_307969.testsuite
Line 162: Line 137:
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_309165.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_309165.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_312047.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_312047.testsuite
 +
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_312258.testsuite
 +
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_315078.testsuite
 +
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_315093.testsuite
 +
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_321475.testsuite
 +
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_323688.testsuite
 +
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_325129.testsuite
 +
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_327681.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_deployment_check.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_deployment_check.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.Proxy.FileProxyNodeCacheTest.testsuite
 
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.Proxy.FileProxyNodeCacheTest.testsuite
Line 194: Line 176:
 
**/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite  
 
**/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite  
 
**Executed once per release during TP1 of the last iteration:  
 
**Executed once per release during TP1 of the last iteration:  
 +
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Recording.technical_review.Windows_IA32.testsuite
 
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Datapools.technical_review.Windows_IA32.testsuite  
 
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Datapools.technical_review.Windows_IA32.testsuite  
 
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Deployment.technical_review.Windows_IA32.testsuite  
 
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Deployment.technical_review.Windows_IA32.testsuite  
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.General.technical_review.Windows_IA32.testsuite  
+
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.ASF.technical_review.Windows_IA32.testsuite
 
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit.technical_review.Windows_IA32.testsuite  
 
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit.technical_review.Windows_IA32.testsuite  
 
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit_Plugin.technical_review.Windows_IA32.testsuite  
 
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit_Plugin.technical_review.Windows_IA32.testsuite  
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Manual.technical_review.Windows_IA32.testsuite
 
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Test_Log_Viewer.technical_review.Windows_IA32.testsuite
 
 
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.URL.technical_review.Windows_IA32.testsuite  
 
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.URL.technical_review.Windows_IA32.testsuite  
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.ASF.technical_review.Windows_IA32.testsuite
+
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Test_Log_Viewer.technical_review.Windows_IA32.testsuite
  
 
=== JUnit  ===
 
=== JUnit  ===
Line 214: Line 195:
 
=== AGR  ===
 
=== AGR  ===
  
*Check the results for the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#AGR AGR BVT tests] for the candidate build.
+
*Test Navigator tests:  
 +
**/org.eclipse.hyades.test.ui.navigator.tests/gui/Test.UI.TestNavigator_Logical_auto.testsuite
 +
**/org.eclipse.hyades.test.ui.navigator.tests/gui/Test.UI.TestNavigator_Resource_auto.testsuite
 +
 
 +
*Datapool tests:
 +
**/org.eclipse.hyades.test.ui.datapool.tests/gui/Test.UI.Datapool_Running.testsuite
 +
 
 +
*JUnit tests:
 +
<!--
 +
**/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM15_JUnitRunner.testsuite
 +
**/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM16_JUnitRunner.testsuite
 +
**/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun15_JUnitRunner.testsuite
 +
**/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun16_JUnitRunner.testsuite
 +
-->
 +
**/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.JUnitRunner.Bug186196.testsuite
 +
 
 +
<!--
 +
*Test Log View tests:
 +
**/org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_linux.testsuite
 +
**/org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_windows.testsuite
 +
-->
  
 
== Test Pass 2 (<1 week) ==
 
== Test Pass 2 (<1 week) ==
Line 252: Line 253:
 
=== AGR  ===
 
=== AGR  ===
  
*Check the results for the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#AGR AGR BVT tests] for the candidate build.
+
*See the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#AGR AGR Test Pass 1 tests].
  
 
== Smoke Test Pass (<1 day) ==
 
== Smoke Test Pass (<1 day) ==
Line 262: Line 263:
  
 
*Datapool tests:  
 
*Datapool tests:  
 +
**/org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite
 
**/org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
 
**/org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
  
Line 286: Line 288:
 
=== AGR  ===
 
=== AGR  ===
  
*Check the results for the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#AGR AGR BVT tests] for the candidate build.
+
*See the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#AGR AGR Test Pass 1 tests].

Latest revision as of 06:54, 30 November 2010

Test Project Testing

For more information on the Test Project testing process, see the TPTP Testing Strategy.

Test Automation

Over time, our goal is to automate as many of the manual tests as possible using the Abbot Java GUI Test Framework or SWTBot to reduce testing costs and improve quality through repeatable tests (for example, BVTs). The manual test suites marked in red are the next candidates for test automation.

Build Verification Test (BVT)

Automated test suites are executed with each Build Verification Test (BVT) (see http://www.eclipse.org/tptp/home/downloads >> Development - <Release Version> >> <Build ID> >> Build Reports >> BVT Results) and reported in each test pass report (see http://www.eclipse.org/tptp >> Development Plan >> Releases Under Development >> Release <Release Version> >> Test Pass Reports).

For more information on the TPTP Build Verification Test (BVT) process, see TPTP Testing Strategy Part 2 - Test Conventions and Best Practices.

JUnit

  • Test Tools Core tests:
    • /org.eclipse.hyades.test.tools.core.tests/junit/common/util/Test.Execution.CommonRunner.XMLUtil.Test.testsuite
    • /org.eclipse.hyades.test.tools.core.tests/junit/Test.HTTP.HttpCookieCacheTest.testsuite
  • Test Model tests:
    • /org.eclipse.hyades.test.core.tests/junit/model/facade/Test.Model.Facade.Test.testsuite
    • /org.eclipse.hyades.test.core.tests/junit/model/Test.Model.Test.Log.Search.Test.testsuite
    • /org.eclipse.hyades.test.core.tests/junit/util/Test.Util.EMFUtil.Test.testsuite
  • Test Harness tests:
    • /org.eclipse.hyades.test.core.tests/junit/harness/Test.Harness.JavaExecutionDeploymentAdapter.Test.testsuite
  • Datapool tests:
    • /org.eclipse.hyades.test.ui.datapool.tests/junit/datapool/Test.UI.DatapoolEditor_running.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/junit/datapool/Test.UI.EncryptedDatapoolEditor_running.testsuite
  • ASF tests:
    • /org.eclipse.tptp.test.testservices.tests/junit/Test.FilesystemServiceTest.testsuite
    • /org.eclipse.tptp.test.testservices.tests/junit/Test.RemoteTestServices.testsuite

JUnit Plug-in

  • Test Core tests:
    • /org.eclipse.hyades.test.core.tests/junit_plugin/launch/facade/Test.Core.Launch.Facade.Deployment.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/launch/facade/Test.Core.Launch.Facade.Test.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/launch/facade/Test.Core.Launch.Facade.TestLog.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/launch/extensions/DeploymentsProviderTest.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/launch/extensions/ExecutionHistoryDefaultsProviderTest.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/launch/extensions/DatapoolHandlerTest.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/model/Test.Model.Datapool.Test.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/recorder/Test.Recorder.JNIWrapper.Test.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/util/Test.Util.JavaUtil.Test.testsuite
  • Test Navigator tests:
    • /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.FileProxyMarkerPersisterTest.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.FileProxyMetadataPersisterTest.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.FileProxyNodeCacheTest.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestNavigatorProxyTest.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestUIUtilTest.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestUIUtilitiesTest.testsuite
  • Datapool tests:
    • /org.eclipse.hyades.test.ui.datapool.tests/junit_plugin/datapool/Test.UI.Datapool_Running.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/junit_plugin/datapool/Test.UI.EncryptedDatapool_Running.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/junit_plugin/datapool/Test.UI.DatapoolUtilities.testsuite
  • JUnit tests:
    • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.CodeSynchronizationTest.testsuite
    • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestGeneration.testsuite
    • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestSuiteFacadeTest.testsuite
  • Test Log View tests:
    • /org.eclipse.hyades.test.ui.logViewer.tests/junit_plugin/Test.UI.FrameworkEditors_logViewer_UtilitiesTest.testsuite
  • ASF tests:
    • /org.eclipse.hyades.test.core.services.tests/junit_plugin/Test.Execution.ServiceUtilTest.testsuite

Test Pass 1 (<2 weeks)

Manual

  • Test Core tests:
    • /org.eclipse.hyades.test.core.tests/manual/core/Test.Core.Plugin.Test.testsuite
  • Test Execution tests:
    • /org.eclipse.hyades.execution.harness.tests/manual/defects/Test.Execution.ExecutionHarness.testsuite
  • Test Navigator tests:
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_166025.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_168055.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_195203.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_225157.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_231786.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232070.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232089.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232310.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232397.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_235447.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_235836.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_236426.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_241850.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_242645.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_242701.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_243358.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_243359.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_245539.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247185.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247987.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247989.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_248255.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_248413.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_249587.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_250245.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_250269.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_253688.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_254459.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_256362.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_262150.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_262402.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263267.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263805.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263950.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_266728.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_273111.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_274496.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_277525.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_279986.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_281249.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_282145.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_282691.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_284071.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_287472.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_293559.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_294795.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_295877.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_296157.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_299137.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_304974.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_307969.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_308891.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_309165.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_312047.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_312258.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_315078.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_315093.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_321475.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_323688.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_325129.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_327681.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_deployment_check.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.Proxy.FileProxyNodeCacheTest.testsuite
  • Datapool tests:
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_editing.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.Datapool_Running.testsuite
  • JUnit tests:
    • /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitRunner.testsuite
  • JUnit Plug-in tests:
    • /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite
  • URL tests:
    • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
    • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Linux.testsuite
    • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.Execution.URLRunner.Remote.testsuite
    • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.IPV6.testsuite
  • ASF tests:
    • /org.eclipse.hyades.test.core.services.tests/manual/Test.Execution.Services.testsuite
  • Test Log View tests:
    • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_linux.testsuite
    • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_windows.testsuite
    • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_extensibility.testsuite
  • Documentation tests:
    • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite
    • Executed once per release during TP1 of the last iteration:
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Recording.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Datapools.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Deployment.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.ASF.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit_Plugin.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.URL.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Test_Log_Viewer.technical_review.Windows_IA32.testsuite

JUnit

JUnit Plug-in

AGR

  • Test Navigator tests:
    • /org.eclipse.hyades.test.ui.navigator.tests/gui/Test.UI.TestNavigator_Logical_auto.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/gui/Test.UI.TestNavigator_Resource_auto.testsuite
  • Datapool tests:
    • /org.eclipse.hyades.test.ui.datapool.tests/gui/Test.UI.Datapool_Running.testsuite
  • JUnit tests:
    • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.JUnitRunner.Bug186196.testsuite


Test Pass 2 (<1 week)

Manual

  • Datapool tests:
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
  • URL tests:
    • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
  • Test Log View tests:
    • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_windows.testsuite

JUnit

JUnit Plug-in

AGR

Smoke Test Pass (<1 day)

Manual

  • Test Navigator tests:
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_166025.testsuite
  • Datapool tests:
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
  • URL tests:
    • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
  • Test Log View tests:
    • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_windows.testsuite

JUnit

JUnit Plug-in

AGR

Back to the top