Difference between revisions of "TPTP-Test-Tools-20080421"

Revision as of 10:37, 21 April 2008

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Tony Wang
  • Jerome Bozier

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• This week is I7 TP1 (target: April 25).

Testing

• We want to complete the I7 TP1 by Thursday, April 24.
• The candidate driver will be announced by the Release Engineering Team later today.

4.5 I7 TP1

• TP1 testing assignments:
  • Manual:
    • Tony:
      • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_editing.testsuite
      • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_linux.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_windows.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_extensibility.testsuite
      • /org.eclipse.hyades.execution.harness.tests/manual/defects/Test.Execution.ExecutionHarness.testsuite
      • /org.eclipse.tptp.test.tools.api.tests/manual/Recorder/Test.UI.APIRecorder.Windows_IA32.testsuite
    • Paul:
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.ASF.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Datapools.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Deployment.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.General.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit_Plugin.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Manual.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Test_Log_Viewer.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.URL.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite
      • /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite
    • Duwayne:
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Linux.testsuite
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.Execution.URLRunner.Remote.testsuite
  • JUnit:
    • Tony:
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.IBM16_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.Sun16_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.IBM142_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.IBM15_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.Sun142_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.Sun15_TestServices.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/JUnit/Test.UI.FrameworkEditors_logViewer_UtilitiesTest.testsuite
  • JUnit Plug-in:
    • Tony:
      • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.CodeSynchronizationTest.testsuite
      • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestGeneration.testsuite
      • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestSuiteFacadeTest.testsuite
      • /org.eclipse.hyades.test.core.tests/junit/launch/facade/TestLaunchConfigurationFacadeTest.testsuite
      • /org.eclipse.hyades.test.core.tests/junit/launch/facade/DeploymentLaunchConfigurationFacadeTest.testsuite
      • /org.eclipse.hyades.test.core.tests/junit/launch/facade/ExecutionHistoryLaunchConfigurationFacadeTest.testsuite
      • /org.eclipse.hyades.test.core.tests/junit/launch/extensions/DeploymentsProviderTest.testsuite
      • /org.eclipse.hyades.test.core.tests/junit/launch/extensions/ExecutionHistoryDefaultsProviderTest.testsuite
  • AGR:
    • Tony:
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM6_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun16_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM142_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM15_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun142_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun15_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_linux.testsuite
      • /org.eclipse.hyades.test.ui.logViewer.tests/gui/Test.UI.FrameworkEditors_logViewer_windows.testsuite
      • /org.eclipse.hyades.test.ui.navigator.tests/gui/TestNavigator_Logical_auto.testsuite
      • /org.eclipse.hyades.test.ui.navigator.tests/gui/TestNavigator_Resource_auto.testsuite
      • /org.eclipse.hyades.test.ui.datapool.tests/gui/Test.UI.EncryptedDatapoolEditor.testsuite

News Group

• We still have a backlog of news group posts that require a reply. Please work this week at replying to the posts for your component.

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defect against the Platform Project include:
    • Execution of any testsuite fails using the IAC - InactiveProcessException
  • Outstanding defect against the Test Project include:
    • Paul:
      • AGR Tests require absolute path to Equinox JAR
      • Clear remote workspace launch does not work for remote test execution
      • AGR Tests cannot be run with start ACServer
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests
      • Content missing in Tabular Report
      • Connection property does not deploy all dependencies
      • Connection property does not allow JUnit Plug-in Tests to be executed
    • Duwayne:
      • ASF marshalling return value between service and client adapter does not have support for failures / exceptions
      • Confusing exceptions when running automated services.
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • ANT importExistingProjects throws Exception

Enhancements

• Queries.
• Schedule.

• Jerome:
  • Move, Copy, Delete, Rename and Import/Export test assets: Jerome is continuing on the test cases (use cases) and documentation (extension points). Jerome attached a patch to cover a failing case (Paul will review).

• Alexander Nyßen:
  • Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. AG/PMC approved and waiting for the Contribution Questionnaire (CQ) to be completed for the contribution.

Defects

• Queries.

• Schedule.

• Defects blocking the I7 TP:
  • Paul:
    • Running a test linked to a datapool cause Severe Error: Paul will fix today.
    • HTML Test Report Generation fails - MalformedURLException: unknown protocol: d: Paul is investigating.
  • Jerome:
    • Unable to create proxy for testsuite

• Platform Project impacting the Test Project:
  • Execution of any testsuite fails using the IAC - InactiveProcessException: Bing cannot reproduce. Working with originator to determine if a configuration issue.

• Defects with Community patches that MUST be integrated in I7 (e.g. this week):
  • Duwayne:
    • Difficulties recording a session in Linux: the order/reporting of SWT events on Linux seems to be different than in Windows.: Resolved (FIXED).
    • Certain characters in text on Button causes recorded script not playable: Resolved (FIXED).
    • Continuous single selection in List/Table/Tree cannot be recorded correctly: Resolved (FIXED).
    • Redundant dependency on org.eclipse.ui.testing: Resolved (FIXED).
    • Redundant message to STDOUT when execute in quick mode: Resolved (FIXED).

• Defects that MUST be completed in I7 (e.g. this week):
  • Duwayne:
    • Exception when canceling a recording (before "recording "actually starts): Unresolved. Triaged and Duwayne is working on the fix for Friday.
    • Command Line Execution - overwrite = True flag does not actually overwrite the results: Resolved (WORKSFORME).
    • Cannot remove a test invocation to a removed HTTP request.: Unresolved. Duwayne has a patch and is testing. Once tested/reviewed/approved, Duwayne will integrate by Friday.
      • The invocation for some deleted testcases can't be removed in behaviour tab: Unresolved. Will be fixed with patch for 201896.
  • Jerome:
    • Move, Copy, Delete, Rename and Import/Export test assets: Unresolved (see [#enhancements above].
      • Filename vs. logical name in UI: Unresolved.
      • Adding a location or artifact with a duplicate name of a removed resource in a deployment does not work: Resolved (WORKSFORME). See Move, Copy, Delete, Rename and Import/Export test assets.
    • Test assets' editors (locations, datapools etc) allow save with empty internal names: Resolved (WORKSFORME). See Move, Copy, Delete, Rename and Import/Export test assets.
  • Paul:
    • UI allows to launch non-profilable tests in profile mode: Resolved (FIXED).
    • Unmovable rows in Datapool Editor: Resolved (FIXED).
    • Usability - adding existing artifacts/locations to deployment should select by name (not filename): Resolved (FIXED).
    • (Usability) creating TPTP test but you need to have parent project created first.: Resolved (FIXED).
    • Context sensitive help requires refactoring and new content.: Unresolved. Requires a technical review of the Test Tools documentation (see Technical review of Test Project documentation before 4.5 release). Deferring to I8.
    • scroll bars not appearing when needed in test suite editor and other Hyades: Resolved (FIXED).
    • what does the synchronous option mean for an invocation behavior in a JUnit Test Suite?: Resolved (FIXED).
    • doc updates for section Creating a test deployment: Resolved (FIXED).
    • Location does not contain port number.: Unresolved. Harm raised issues with extending the Test Model to add a port number to a org.eclipse.hyades.models.common.configuration.CFGMachine. Deferring to future.
    • (Usability) HTTP tests do not automatically generate JUnit Java code like JUnit tests.: Unresolved. Insufficient times to complete in I7. Deferring to I8.
    • Test editors: links to test elements don't do highlighting anymore: Resolved (FIXED).
    • Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.: Unresolved. Insufficient times to complete in I7. Required for the technical review of the Test Tools documentation (see Technical review of Test Project documentation before 4.5 release). Deferring to I8.
  • Tony:
    • Accessibility-Need shortcuts for all Test Navigator pulldowns: Unresolved. Problems with shortcuts for on Test Navigator context menus. Deferring to I8.

Round-table

Paul

• Last Week:
  • Resolved defects:
    • (Web) Test execution periodically hangs.
    • (Web) (Vista) Test execution terminates abnormally.
    • NLS34 - Found 2 consecutive single quotes in text not handled by Java MessageFormat class
    • Time Frame Historical Report view does not have tabs and is missing info
    • Test Tools about.properties files contain incorrect descriptions.
    • Recorder Control view is not opened or has focus when a recording is started
    • Can not cancel changes while closing datapool editor
    • Vista-specific error dialog when recording using IAC/IE on XP.
    • NullPointerException when deleting artifact location pairs.
    • Time out error message during test execution is not resolving.
    • Test Log Viewer: Link to deployment is displayed when using temp deploy not named 'default'
    • No help for datapool/TPTP wizard.
    • (Usability) Missing/inconsistent titles/descriptions/icons in test report dialogs.
    • Test Tools documentation I5/I6 smoke test failures.
    • System default browser is not used as the default browser for URL recording.
    • The 'Encrypt' option doesn't work with keyboard selection
    • Garbage output in recorder log when non-translated strings are sent by the agent
    • "Paste" doesn't not complete normally
    • Generate Report: Test Navigator does not refresh to show new report
    • (Test Navigator) Resource Information is not available for package and source folder nodes
    • Unable to load file /Test/ejb2.testsuite during test generation
    • variables are listed twice in the "EquivalenceClass" pane of Datapool

• This Week:
  • See Defects.

Duwayne

• Last Week:
  • Resolved defects:
    • Test Execution Fails
    • Consumming Product: ASF Throws Modal Dialog Box.
    • No data is recorded when recording after a hung/cancelled test execution.
    • Playback does not run using Jre142 in AC
  • Assisted with triaging File transfer functionality fails when connecting with previous agent controllers

• This Week:
  • See Defects.

Jerome

• Last Week:
  • TBD

• This Week:
  • See Defects.

Tony

• Last Week:
  • Updated to Test.Execution.JUnitRunner.testsuite and Test.Execution.JUnitRunner.Bug186196.testsuite are failing..
  • Worked on Accessibility-Need shortcuts for all Test Navigator pulldowns.

• This Week:
  • See Defects.
  • Testing:
    • Java 6.
    • P2 Equinox
  • Alternatively:
    • Context sensitive help requires refactoring and new content.

Action items

• None.

Notes

• None.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.