Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "TPTP Test Tools Project Tests"
(→Build Verification Test (BVT)) |
(→Manual) |
||
| (47 intermediate revisions by 2 users not shown) | |||
| Line 5: | Line 5: | ||
== Test Automation == | == Test Automation == | ||
| − | Over time, our goal is to automate as many of the manual tests as possible using | + | Over time, our goal is to automate as many of the manual tests as possible using the [http://abbot.sourceforge.net/doc/overview.shtml Abbot Java GUI Test Framework] or [http://www.eclipse.org/swtbot/ SWTBot] to reduce testing costs and improve quality through repeatable tests (for example, BVTs). The [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#Manual manual test suites] marked in <font color="red">red</font> are the next candidates for test automation. |
== Build Verification Test (BVT) == | == Build Verification Test (BVT) == | ||
| − | Automated test suites are executed with each Build Verification Test (BVT) (see [http://www.eclipse.org/tptp/home/downloads http://www.eclipse.org/tptp/home/downloads] >> Development - ''<Release Version>'' >> ''<Build ID>'' >> Build Reports >> BVT Results) and reported in each test pass report (see [http://www.eclipse.org/tptp http://www.eclipse.org/tptp] >> Development Plan >> Releases Under Development >> Release ''<Release Version>'' >> Test Pass Reports). | + | Automated test suites are executed with each Build Verification Test (BVT) (see [http://www.eclipse.org/tptp/home/downloads http://www.eclipse.org/tptp/home/downloads] >> Development - ''<Release Version>'' >> ''<Build ID>'' >> Build Reports >> BVT Results) and reported in each test pass report (see [http://www.eclipse.org/tptp http://www.eclipse.org/tptp] >> Development Plan >> Releases Under Development >> Release ''<Release Version>'' >> Test Pass Reports). |
For more information on the TPTP Build Verification Test (BVT) process, see [http://www.eclipse.org/tptp/home/documents/process/test/automation/process/TPTP_Testing_Strategy_Part_2.html#5.0 TPTP Testing Strategy Part 2 - Test Conventions and Best Practices]. | For more information on the TPTP Build Verification Test (BVT) process, see [http://www.eclipse.org/tptp/home/documents/process/test/automation/process/TPTP_Testing_Strategy_Part_2.html#5.0 TPTP Testing Strategy Part 2 - Test Conventions and Best Practices]. | ||
| Line 23: | Line 23: | ||
**/org.eclipse.hyades.test.core.tests/junit/model/Test.Model.Test.Log.Search.Test.testsuite | **/org.eclipse.hyades.test.core.tests/junit/model/Test.Model.Test.Log.Search.Test.testsuite | ||
**/org.eclipse.hyades.test.core.tests/junit/util/Test.Util.EMFUtil.Test.testsuite | **/org.eclipse.hyades.test.core.tests/junit/util/Test.Util.EMFUtil.Test.testsuite | ||
| + | |||
| + | *Test Harness tests: | ||
| + | **/org.eclipse.hyades.test.core.tests/junit/harness/Test.Harness.JavaExecutionDeploymentAdapter.Test.testsuite | ||
*Datapool tests: | *Datapool tests: | ||
| Line 42: | Line 45: | ||
**/org.eclipse.hyades.test.core.tests/junit_plugin/launch/extensions/DatapoolHandlerTest.testsuite | **/org.eclipse.hyades.test.core.tests/junit_plugin/launch/extensions/DatapoolHandlerTest.testsuite | ||
**/org.eclipse.hyades.test.core.tests/junit_plugin/model/Test.Model.Datapool.Test.testsuite | **/org.eclipse.hyades.test.core.tests/junit_plugin/model/Test.Model.Datapool.Test.testsuite | ||
| + | **/org.eclipse.hyades.test.core.tests/junit_plugin/recorder/Test.Recorder.JNIWrapper.Test.testsuite | ||
| + | **/org.eclipse.hyades.test.core.tests/junit_plugin/util/Test.Util.JavaUtil.Test.testsuite | ||
*Test Navigator tests: | *Test Navigator tests: | ||
| − | **/org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test. | + | **/org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.FileProxyMarkerPersisterTest.testsuite |
| + | **/org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.FileProxyMetadataPersisterTest.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.FileProxyNodeCacheTest.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestNavigatorProxyTest.testsuite | ||
**/org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestUIUtilTest.testsuite | **/org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestUIUtilTest.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestUIUtilitiesTest.testsuite | ||
*Datapool tests: | *Datapool tests: | ||
| Line 62: | Line 71: | ||
*ASF tests: | *ASF tests: | ||
**/org.eclipse.hyades.test.core.services.tests/junit_plugin/Test.Execution.ServiceUtilTest.testsuite | **/org.eclipse.hyades.test.core.services.tests/junit_plugin/Test.Execution.ServiceUtilTest.testsuite | ||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
== Test Pass 1 (<2 weeks) == | == Test Pass 1 (<2 weeks) == | ||
| Line 100: | Line 83: | ||
*Test Navigator tests: | *Test Navigator tests: | ||
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI. | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_166025.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI. | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_168055.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_195203.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_195203.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_225157 | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_225157.testsuite |
| − | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_231786.testsuite | |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_231786.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232070.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232070.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232089.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232089.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232310.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232310.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232397.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232397.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_235447.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_235447.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_235836.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_235836.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_236426.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_236426.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_241850.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_241850.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_242645.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_242645.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_242701.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_242701.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_243358.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_243358.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_243359.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_243359.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_245539.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_245539.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247185.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247185.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247987.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247987.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247989.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247989.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_248255.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_248255.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_248413.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_248413.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_249587.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_249587.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_250245.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_250245.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_250269.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_250269.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_253688.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI. | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_254459.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI. | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_256362.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI. | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_262150.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI. | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_262402.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI. | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263267.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI. | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263805.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI. | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263950.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI. | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_266728.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI. | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_273111.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_273111.testsuite | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_274496.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI. | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_277525.testsuite |
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI. | + | |
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_279986.testsuite | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_279986.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_281249.testsuite | ||
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_282145.testsuite | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_282145.testsuite | ||
| − | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI. | + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_282691.testsuite |
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_284071.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_287472.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_293559.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_294795.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_295877.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_296157.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_299137.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_304974.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_307969.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_308891.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_309165.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_312047.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_312258.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_315078.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_315093.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_321475.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_323688.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_325129.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_327681.testsuite | ||
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_deployment_check.testsuite | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_deployment_check.testsuite | ||
**/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.Proxy.FileProxyNodeCacheTest.testsuite | **/org.eclipse.hyades.test.ui.navigator.tests/manual/Test.Proxy.FileProxyNodeCacheTest.testsuite | ||
| − | |||
| − | |||
| − | |||
*Datapool tests: | *Datapool tests: | ||
| Line 177: | Line 176: | ||
**/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite | **/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite | ||
**Executed once per release during TP1 of the last iteration: | **Executed once per release during TP1 of the last iteration: | ||
| + | ***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Recording.technical_review.Windows_IA32.testsuite | ||
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Datapools.technical_review.Windows_IA32.testsuite | ***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Datapools.technical_review.Windows_IA32.testsuite | ||
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Deployment.technical_review.Windows_IA32.testsuite | ***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Deployment.technical_review.Windows_IA32.testsuite | ||
| − | ***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc. | + | ***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.ASF.technical_review.Windows_IA32.testsuite |
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit.technical_review.Windows_IA32.testsuite | ***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit.technical_review.Windows_IA32.testsuite | ||
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit_Plugin.technical_review.Windows_IA32.testsuite | ***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit_Plugin.technical_review.Windows_IA32.testsuite | ||
| − | |||
| − | |||
***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.URL.technical_review.Windows_IA32.testsuite | ***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.URL.technical_review.Windows_IA32.testsuite | ||
| − | ***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc. | + | ***/org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Test_Log_Viewer.technical_review.Windows_IA32.testsuite |
=== JUnit === | === JUnit === | ||
| − | *Check the results for the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#JUnit JUnit BVT tests] for the candidate build. | + | *Check the results for the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#JUnit JUnit BVT tests] for the candidate build. |
=== JUnit Plug-in === | === JUnit Plug-in === | ||
| − | *Check the results for the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#JUnit_Plug-in JUnit Plug-in BVT tests] for the candidate build. | + | *Check the results for the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#JUnit_Plug-in JUnit Plug-in BVT tests] for the candidate build. |
=== AGR === | === AGR === | ||
| − | * | + | *Test Navigator tests: |
| + | **/org.eclipse.hyades.test.ui.navigator.tests/gui/Test.UI.TestNavigator_Logical_auto.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.navigator.tests/gui/Test.UI.TestNavigator_Resource_auto.testsuite | ||
| + | |||
| + | *Datapool tests: | ||
| + | **/org.eclipse.hyades.test.ui.datapool.tests/gui/Test.UI.Datapool_Running.testsuite | ||
| + | |||
| + | *JUnit tests: | ||
| + | <!-- | ||
| + | **/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM15_JUnitRunner.testsuite | ||
| + | **/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM16_JUnitRunner.testsuite | ||
| + | **/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun15_JUnitRunner.testsuite | ||
| + | **/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun16_JUnitRunner.testsuite | ||
| + | --> | ||
| + | **/org.eclipse.hyades.test.java.tests/autoui/Test.Execution.JUnitRunner.Bug186196.testsuite | ||
| + | |||
| + | <!-- | ||
| + | *Test Log View tests: | ||
| + | **/org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_linux.testsuite | ||
| + | **/org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_windows.testsuite | ||
| + | --> | ||
== Test Pass 2 (<1 week) == | == Test Pass 2 (<1 week) == | ||
| Line 204: | Line 222: | ||
*Test Navigator tests: | *Test Navigator tests: | ||
| − | |||
| − | |||
| − | |||
**See the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#Manual Manual Test Pass 1 tests]. | **See the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#Manual Manual Test Pass 1 tests]. | ||
| Line 230: | Line 245: | ||
=== JUnit === | === JUnit === | ||
| − | *Check the results for the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#JUnit JUnit BVT tests] for the candidate build. | + | *Check the results for the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#JUnit JUnit BVT tests] for the candidate build. |
=== JUnit Plug-in === | === JUnit Plug-in === | ||
| − | *Check the results for the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#JUnit_Plug-in JUnit Plug-in BVT tests] for the candidate build. | + | *Check the results for the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#JUnit_Plug-in JUnit Plug-in BVT tests] for the candidate build. |
=== AGR === | === AGR === | ||
| − | * | + | *See the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#AGR AGR Test Pass 1 tests]. |
| − | + | ||
| − | + | ||
== Smoke Test Pass (<1 day) == | == Smoke Test Pass (<1 day) == | ||
| Line 250: | Line 263: | ||
*Datapool tests: | *Datapool tests: | ||
| + | **/org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite | ||
**/org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite | **/org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite | ||
| Line 266: | Line 280: | ||
=== JUnit === | === JUnit === | ||
| − | *Check the results for the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#JUnit JUnit BVT tests] for the candidate build. | + | *Check the results for the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#JUnit JUnit BVT tests] for the candidate build. |
=== JUnit Plug-in === | === JUnit Plug-in === | ||
| − | *Check the results for the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#JUnit_Plug-in JUnit Plug-in BVT tests] for the candidate build. | + | *Check the results for the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#JUnit_Plug-in JUnit Plug-in BVT tests] for the candidate build. |
=== AGR === | === AGR === | ||
| − | * | + | *See the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests#AGR AGR Test Pass 1 tests]. |
Latest revision as of 06:54, 30 November 2010
Contents
Test Project Testing
For more information on the Test Project testing process, see the TPTP Testing Strategy.
Test Automation
Over time, our goal is to automate as many of the manual tests as possible using the Abbot Java GUI Test Framework or SWTBot to reduce testing costs and improve quality through repeatable tests (for example, BVTs). The manual test suites marked in red are the next candidates for test automation.
Build Verification Test (BVT)
Automated test suites are executed with each Build Verification Test (BVT) (see http://www.eclipse.org/tptp/home/downloads >> Development - <Release Version> >> <Build ID> >> Build Reports >> BVT Results) and reported in each test pass report (see http://www.eclipse.org/tptp >> Development Plan >> Releases Under Development >> Release <Release Version> >> Test Pass Reports).
For more information on the TPTP Build Verification Test (BVT) process, see TPTP Testing Strategy Part 2 - Test Conventions and Best Practices.
JUnit
- Test Tools Core tests:
- /org.eclipse.hyades.test.tools.core.tests/junit/common/util/Test.Execution.CommonRunner.XMLUtil.Test.testsuite
- /org.eclipse.hyades.test.tools.core.tests/junit/Test.HTTP.HttpCookieCacheTest.testsuite
- Test Model tests:
- /org.eclipse.hyades.test.core.tests/junit/model/facade/Test.Model.Facade.Test.testsuite
- /org.eclipse.hyades.test.core.tests/junit/model/Test.Model.Test.Log.Search.Test.testsuite
- /org.eclipse.hyades.test.core.tests/junit/util/Test.Util.EMFUtil.Test.testsuite
- Test Harness tests:
- /org.eclipse.hyades.test.core.tests/junit/harness/Test.Harness.JavaExecutionDeploymentAdapter.Test.testsuite
- Datapool tests:
- /org.eclipse.hyades.test.ui.datapool.tests/junit/datapool/Test.UI.DatapoolEditor_running.testsuite
- /org.eclipse.hyades.test.ui.datapool.tests/junit/datapool/Test.UI.EncryptedDatapoolEditor_running.testsuite
- ASF tests:
- /org.eclipse.tptp.test.testservices.tests/junit/Test.FilesystemServiceTest.testsuite
- /org.eclipse.tptp.test.testservices.tests/junit/Test.RemoteTestServices.testsuite
JUnit Plug-in
- Test Core tests:
- /org.eclipse.hyades.test.core.tests/junit_plugin/launch/facade/Test.Core.Launch.Facade.Deployment.testsuite
- /org.eclipse.hyades.test.core.tests/junit_plugin/launch/facade/Test.Core.Launch.Facade.Test.testsuite
- /org.eclipse.hyades.test.core.tests/junit_plugin/launch/facade/Test.Core.Launch.Facade.TestLog.testsuite
- /org.eclipse.hyades.test.core.tests/junit_plugin/launch/extensions/DeploymentsProviderTest.testsuite
- /org.eclipse.hyades.test.core.tests/junit_plugin/launch/extensions/ExecutionHistoryDefaultsProviderTest.testsuite
- /org.eclipse.hyades.test.core.tests/junit_plugin/launch/extensions/DatapoolHandlerTest.testsuite
- /org.eclipse.hyades.test.core.tests/junit_plugin/model/Test.Model.Datapool.Test.testsuite
- /org.eclipse.hyades.test.core.tests/junit_plugin/recorder/Test.Recorder.JNIWrapper.Test.testsuite
- /org.eclipse.hyades.test.core.tests/junit_plugin/util/Test.Util.JavaUtil.Test.testsuite
- Test Navigator tests:
- /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.FileProxyMarkerPersisterTest.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.FileProxyMetadataPersisterTest.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.FileProxyNodeCacheTest.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestNavigatorProxyTest.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestUIUtilTest.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestUIUtilitiesTest.testsuite
- Datapool tests:
- /org.eclipse.hyades.test.ui.datapool.tests/junit_plugin/datapool/Test.UI.Datapool_Running.testsuite
- /org.eclipse.hyades.test.ui.datapool.tests/junit_plugin/datapool/Test.UI.EncryptedDatapool_Running.testsuite
- /org.eclipse.hyades.test.ui.datapool.tests/junit_plugin/datapool/Test.UI.DatapoolUtilities.testsuite
- JUnit tests:
- /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.CodeSynchronizationTest.testsuite
- /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestGeneration.testsuite
- /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestSuiteFacadeTest.testsuite
- Test Log View tests:
- /org.eclipse.hyades.test.ui.logViewer.tests/junit_plugin/Test.UI.FrameworkEditors_logViewer_UtilitiesTest.testsuite
- ASF tests:
- /org.eclipse.hyades.test.core.services.tests/junit_plugin/Test.Execution.ServiceUtilTest.testsuite
Test Pass 1 (<2 weeks)
Manual
- Test Core tests:
- /org.eclipse.hyades.test.core.tests/manual/core/Test.Core.Plugin.Test.testsuite
- Test Execution tests:
- /org.eclipse.hyades.execution.harness.tests/manual/defects/Test.Execution.ExecutionHarness.testsuite
- Test Navigator tests:
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_166025.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_168055.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_195203.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_225157.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_231786.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232070.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232089.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232310.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232397.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_235447.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_235836.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_236426.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_241850.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_242645.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_242701.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_243358.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_243359.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_245539.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247185.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247987.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247989.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_248255.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_248413.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_249587.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_250245.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_250269.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_253688.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_254459.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_256362.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_262150.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_262402.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263267.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263805.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263950.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_266728.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_273111.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_274496.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_277525.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_279986.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_281249.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_282145.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_282691.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_284071.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_287472.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_293559.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_294795.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_295877.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_296157.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_299137.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_304974.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_307969.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_308891.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_309165.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_312047.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_312258.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_315078.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_315093.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_321475.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_323688.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_325129.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_327681.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_deployment_check.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.Proxy.FileProxyNodeCacheTest.testsuite
- Datapool tests:
- /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite
- /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
- /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_editing.testsuite
- /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.Datapool_Running.testsuite
- JUnit tests:
- /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitRunner.testsuite
- JUnit Plug-in tests:
- /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite
- URL tests:
- /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
- /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Linux.testsuite
- /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.Execution.URLRunner.Remote.testsuite
- /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.IPV6.testsuite
- ASF tests:
- /org.eclipse.hyades.test.core.services.tests/manual/Test.Execution.Services.testsuite
- Test Log View tests:
- /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_linux.testsuite
- /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_windows.testsuite
- /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_extensibility.testsuite
- Documentation tests:
- /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite
- Executed once per release during TP1 of the last iteration:
- /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Recording.technical_review.Windows_IA32.testsuite
- /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Datapools.technical_review.Windows_IA32.testsuite
- /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Deployment.technical_review.Windows_IA32.testsuite
- /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.ASF.technical_review.Windows_IA32.testsuite
- /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit.technical_review.Windows_IA32.testsuite
- /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit_Plugin.technical_review.Windows_IA32.testsuite
- /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.URL.technical_review.Windows_IA32.testsuite
- /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Test_Log_Viewer.technical_review.Windows_IA32.testsuite
JUnit
- Check the results for the JUnit BVT tests for the candidate build.
JUnit Plug-in
- Check the results for the JUnit Plug-in BVT tests for the candidate build.
AGR
- Test Navigator tests:
- /org.eclipse.hyades.test.ui.navigator.tests/gui/Test.UI.TestNavigator_Logical_auto.testsuite
- /org.eclipse.hyades.test.ui.navigator.tests/gui/Test.UI.TestNavigator_Resource_auto.testsuite
- Datapool tests:
- /org.eclipse.hyades.test.ui.datapool.tests/gui/Test.UI.Datapool_Running.testsuite
- JUnit tests:
- /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.JUnitRunner.Bug186196.testsuite
Test Pass 2 (<1 week)
Manual
- Test Navigator tests:
- See the Manual Test Pass 1 tests.
- Datapool tests:
- /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite
- /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
- JUnit tests:
- See the Manual Test Pass 1 tests.
- JUnit Plug-in tests:
- See the Manual Test Pass 1 tests.
- URL tests:
- /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
- ASF tests:
- See the Manual Test Pass 1 tests.
- Test Log View tests:
- /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_windows.testsuite
JUnit
- Check the results for the JUnit BVT tests for the candidate build.
JUnit Plug-in
- Check the results for the JUnit Plug-in BVT tests for the candidate build.
AGR
- See the AGR Test Pass 1 tests.
Smoke Test Pass (<1 day)
Manual
- Test Navigator tests:
- /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_166025.testsuite
- Datapool tests:
- /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite
- /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
- JUnit tests:
- See the Manual Test Pass 1 tests.
- JUnit Plug-in tests:
- See the Manual Test Pass 1 tests.
- URL tests:
- /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
- Test Log View tests:
- /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_windows.testsuite
JUnit
- Check the results for the JUnit BVT tests for the candidate build.
JUnit Plug-in
- Check the results for the JUnit Plug-in BVT tests for the candidate build.
AGR
- See the AGR Test Pass 1 tests.