Jump to: navigation, search

TPTP Test Tools Project Tests

Test Project Testing

For more information on the Test Project testing process, see the TPTP Testing Strategy.

Test Automation

Over time, our goal is to automate as many of the manual tests as possible using the Abbot Java GUI Test Framework or SWTBot to reduce testing costs and improve quality through repeatable tests (for example, BVTs). The manual test suites marked in red are the next candidates for test automation.

Build Verification Test (BVT)

Automated test suites are executed with each Build Verification Test (BVT) (see http://www.eclipse.org/tptp/home/downloads >> Development - <Release Version> >> <Build ID> >> Build Reports >> BVT Results) and reported in each test pass report (see http://www.eclipse.org/tptp >> Development Plan >> Releases Under Development >> Release <Release Version> >> Test Pass Reports).

For more information on the TPTP Build Verification Test (BVT) process, see TPTP Testing Strategy Part 2 - Test Conventions and Best Practices.

JUnit

  • Test Tools Core tests:
    • /org.eclipse.hyades.test.tools.core.tests/junit/common/util/Test.Execution.CommonRunner.XMLUtil.Test.testsuite
    • /org.eclipse.hyades.test.tools.core.tests/junit/Test.HTTP.HttpCookieCacheTest.testsuite
  • Test Model tests:
    • /org.eclipse.hyades.test.core.tests/junit/model/facade/Test.Model.Facade.Test.testsuite
    • /org.eclipse.hyades.test.core.tests/junit/model/Test.Model.Test.Log.Search.Test.testsuite
    • /org.eclipse.hyades.test.core.tests/junit/util/Test.Util.EMFUtil.Test.testsuite
  • Test Harness tests:
    • /org.eclipse.hyades.test.core.tests/junit/harness/Test.Harness.JavaExecutionDeploymentAdapter.Test.testsuite
  • Datapool tests:
    • /org.eclipse.hyades.test.ui.datapool.tests/junit/datapool/Test.UI.DatapoolEditor_running.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/junit/datapool/Test.UI.EncryptedDatapoolEditor_running.testsuite
  • ASF tests:
    • /org.eclipse.tptp.test.testservices.tests/junit/Test.FilesystemServiceTest.testsuite
    • /org.eclipse.tptp.test.testservices.tests/junit/Test.RemoteTestServices.testsuite

JUnit Plug-in

  • Test Core tests:
    • /org.eclipse.hyades.test.core.tests/junit_plugin/launch/facade/Test.Core.Launch.Facade.Deployment.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/launch/facade/Test.Core.Launch.Facade.Test.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/launch/facade/Test.Core.Launch.Facade.TestLog.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/launch/extensions/DeploymentsProviderTest.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/launch/extensions/ExecutionHistoryDefaultsProviderTest.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/launch/extensions/DatapoolHandlerTest.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/model/Test.Model.Datapool.Test.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/recorder/Test.Recorder.JNIWrapper.Test.testsuite
    • /org.eclipse.hyades.test.core.tests/junit_plugin/util/Test.Util.JavaUtil.Test.testsuite
  • Test Navigator tests:
    • /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.FileProxyMarkerPersisterTest.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.FileProxyMetadataPersisterTest.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.FileProxyNodeCacheTest.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestNavigatorProxyTest.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestUIUtilTest.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/junit_plugin/Test.UI.TestUIUtilitiesTest.testsuite
  • Datapool tests:
    • /org.eclipse.hyades.test.ui.datapool.tests/junit_plugin/datapool/Test.UI.Datapool_Running.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/junit_plugin/datapool/Test.UI.EncryptedDatapool_Running.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/junit_plugin/datapool/Test.UI.DatapoolUtilities.testsuite
  • JUnit tests:
    • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.CodeSynchronizationTest.testsuite
    • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestGeneration.testsuite
    • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestSuiteFacadeTest.testsuite
  • Test Log View tests:
    • /org.eclipse.hyades.test.ui.logViewer.tests/junit_plugin/Test.UI.FrameworkEditors_logViewer_UtilitiesTest.testsuite
  • ASF tests:
    • /org.eclipse.hyades.test.core.services.tests/junit_plugin/Test.Execution.ServiceUtilTest.testsuite

Test Pass 1 (<2 weeks)

Manual

  • Test Core tests:
    • /org.eclipse.hyades.test.core.tests/manual/core/Test.Core.Plugin.Test.testsuite
  • Test Execution tests:
    • /org.eclipse.hyades.execution.harness.tests/manual/defects/Test.Execution.ExecutionHarness.testsuite
  • Test Navigator tests:
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_166025.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_168055.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_195203.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_225157.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_231786.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232070.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232089.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232310.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_232397.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_235447.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_235836.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_236426.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_241850.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_242645.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_242701.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_243358.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_243359.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_245539.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247185.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247987.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_247989.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_248255.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_248413.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_249587.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_250245.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_250269.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_253688.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_254459.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_256362.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_262150.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_262402.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263267.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263805.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_263950.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_266728.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_273111.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_274496.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_277525.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_279986.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_281249.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_282145.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_282691.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_284071.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_287472.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_293559.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_294795.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_295877.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_296157.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_299137.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_304974.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_307969.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_308891.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_309165.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_312047.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_312258.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_315078.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_315093.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_321475.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_323688.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_325129.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_327681.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_deployment_check.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.Proxy.FileProxyNodeCacheTest.testsuite
  • Datapool tests:
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_editing.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.Datapool_Running.testsuite
  • JUnit tests:
    • /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitRunner.testsuite
  • JUnit Plug-in tests:
    • /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite
  • URL tests:
    • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
    • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Linux.testsuite
    • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.Execution.URLRunner.Remote.testsuite
    • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.IPV6.testsuite
  • ASF tests:
    • /org.eclipse.hyades.test.core.services.tests/manual/Test.Execution.Services.testsuite
  • Test Log View tests:
    • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_linux.testsuite
    • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_windows.testsuite
    • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_extensibility.testsuite
  • Documentation tests:
    • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite
    • Executed once per release during TP1 of the last iteration:
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Recording.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Datapools.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Deployment.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.ASF.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit_Plugin.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.URL.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Test_Log_Viewer.technical_review.Windows_IA32.testsuite

JUnit

JUnit Plug-in

AGR

  • Test Navigator tests:
    • /org.eclipse.hyades.test.ui.navigator.tests/gui/Test.UI.TestNavigator_Logical_auto.testsuite
    • /org.eclipse.hyades.test.ui.navigator.tests/gui/Test.UI.TestNavigator_Resource_auto.testsuite
  • Datapool tests:
    • /org.eclipse.hyades.test.ui.datapool.tests/gui/Test.UI.Datapool_Running.testsuite
  • JUnit tests:
    • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.JUnitRunner.Bug186196.testsuite


Test Pass 2 (<1 week)

Manual

  • Datapool tests:
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
  • URL tests:
    • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
  • Test Log View tests:
    • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_windows.testsuite

JUnit

JUnit Plug-in

AGR

Smoke Test Pass (<1 day)

Manual

  • Test Navigator tests:
    • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_166025.testsuite
  • Datapool tests:
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite
    • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
  • URL tests:
    • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
  • Test Log View tests:
    • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_windows.testsuite

JUnit

JUnit Plug-in

AGR