Difference between revisions of "TPTP-Test-Tools-20080428"

Revision as of 09:31, 28 April 2008

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Tony Wang
  • Jerome Bozier

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• This week is I7 TP2 (target: April 25).

Testing

• We need to complete I7 TP1 by EOD today using the candidate driver.
• For I7 TP2, Tony will continue running the smoke test suites for the resolved blocking defects.
  • • Paul, Jerome, and Duwayne will continue resolving the defects blocking the I7 TPs.

4.5 I7 TP1

• TP1 testing assignments:
  • Manual:
    • Tony:
      • /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite
      • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_225157.testsuite
      • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
    • Paul:
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite
    • Duwayne:
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Linux.testsuite
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.Execution.URLRunner.Remote.testsuite
  • JUnit:
    • Tony:
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.DatapoolPasswordServicesTest.testsuite
  • AGR:
    • Tony:
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM16_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun16_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM142_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM15_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun142_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun15_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.JUnitRunner.Bug186196.testsuite
      • /org.eclipse.hyades.test.ui.datapool.tests/gui/Test.UI.EncryptedDatapoolEditor.testsuite

News Group

• The following news group posts require a reply:
  • Duwayne:
    • Re: Using wait command in AGR script (March 11, 2008 2:07 PM)
    • Re: HTTP Recording stops immediately after start-up (FireFox) or never records data (IE) (March 25, 2008 1:15 PM)
    • tptp execuation task issue (April 2, 2008 3:12 PM)
    • Multi-Language tests with AGR (April 7, 2008 3:11 PM)
    • Testing an application with Custom component (April 8, 2008 11:03 AM)
    • Re: NoClassDefFoundError: org.eclipse.hyades.test.common...? (April 10, 2008 5:33 PM)

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defect against the Platform Project include:
    • Execution of any testsuite fails using the IAC - InactiveProcessException
  • Outstanding defect against the Test Project include:
    • Paul:
      • AGR Tests require absolute path to Equinox JAR
      • Clear remote workspace launch does not work for remote test execution
      • AGR Tests cannot be run with start ACServer
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests
      • Content missing in Tabular Report
      • Connection property does not deploy all dependencies
      • Connection property does not allow JUnit Plug-in Tests to be executed
    • Duwayne:
      • ASF marshalling return value between service and client adapter does not have support for failures / exceptions
      • Confusing exceptions when running automated services.
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • ANT importExistingProjects throws Exception

Enhancements

• Queries.
• Schedule.

• Jerome:
  • Move, Copy, Delete, Rename and Import/Export test assets: Complete.

• Alexander Nyßen:
  • Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. AG/PMC approved and Contribution Questionnaire (CQ) approved. Deferred to I8 for integration and testing.

Defects

• Queries.

• Schedule.

• Defects blocking the I7 TPs:
  • Paul:
    • Technical review of Test Project documentation before 4.5 release.
    • [1]
    • [2]: Patch reviewed/approved. Waiting for PMC approval.
    • Running a test linked to a datapool cause Severe Error
  • Duwayne:
    • Exception when canceling a recording (before "recording "actually starts): Unresolved. Triaged and Duwayne is working on the fix for Friday.
    • Cannot remove a test invocation to a removed HTTP request.: Unresolved. Duwayne has a patch and is testing. Once tested/reviewed/approved, Duwayne will integrate by Friday.
      • The invocation for some deleted testcases can't be removed in behaviour tab: Unresolved. Will be fixed with patch for 201896.
  • Jerome:
    • Unable to create proxy for testsuite
    • [3]
    • [4]
  • Tony:
    • Accessibility-Need shortcuts for all Test Navigator pulldowns: Unresolved. Problems with shortcuts for on Test Navigator context menus. Deferring to I8.

• Platform Project impacting the Test Project:
  • Execution of any testsuite fails using the IAC - InactiveProcessException: Bing cannot reproduce. Working with originator to determine if a configuration issue.

• • • Context sensitive help requires refactoring and new content.: Unresolved. Requires a technical review of the Test Tools documentation (see Technical review of Test Project documentation before 4.5 release). Deferring to I8.
    • Location does not contain port number.: Unresolved. Harm raised issues with extending the Test Model to add a port number to a org.eclipse.hyades.models.common.configuration.CFGMachine. Deferring to future.
    • (Usability) HTTP tests do not automatically generate JUnit Java code like JUnit tests.: Unresolved. Insufficient times to complete in I7. Deferring to I8.
    • Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.: Unresolved. Insufficient times to complete in I7. Will complete this week. Required for the technical review of the Test Tools documentation (see Technical review of Test Project documentation before 4.5 release). Will complete this week.

Round-table

Paul

• Last Week:
  • Resolved defects:
    • Regression - Firefox recording error
    • NLS34 - Found 2 consecutive single quotes in text not handled by Java MessageFormat class
    • Garbage output in recorder log when non-translated strings are sent by the agent
    • (Web) (Linux) Cannot not delete test assets in the Test Navigator.
    • (Web) Test execution periodically hangs.
    • (Web) (Vista) Test execution terminates abnormally.
    • doc updates for section Creating a test deployment
    • what does the synchronous option mean for an invocation behavior in a JUnit Test Suite?
    • Time Frame Historical Report view does not have tabs and is missing info
    • Test Tools documentation I5/I6 smoke test failures.
    • UI allows to launch non-profilable tests in profile mode
    • Time out error message during test execution is not resolving.
    • InactiveProcessException when launching AGR tests using the Agent Controller.
    • Time-out Threshold always set to default of 30000
    • InactiveProcessException when launching JUnit Plug-in tests using the Agent Controller.
    • Vista-specific error dialog when recording using IAC/IE on XP.
    • Can not load datapool file while running a Juint test
    • Create TVT/enablement test cases for new Test Project UI.
    • Can not cancel changes while closing datapool editor
    • Test editors: links to test elements don't do highlighting anymore
    • Test Log Viewer: Link to deployment is displayed when using temp deploy not named 'default'
    • variables are listed twice in the "EquivalenceClass" pane of Datapool
    • Test Tools about.properties files contain incorrect descriptions.
    • (Test Navigator) Resource Information is not available for package and source folder nodes
    • "Paste" doesn't not complete normally
    • NullPointerException when deleting artifact location pairs.
    • Encrypted datapool variable support
    • Unmovable rows in Datapool Editor
    • No help for datapool/TPTP wizard.
    • The 'Encrypt' option doesn't work with keyboard selection
    • Usability - adding existing artifacts/locations to deployment should select by name (not filename)
    • scroll bars not appearing when needed in test suite editor and other Hyades editors when content doesn't all fit in a page
    • creating TPTP test but you need to have parent project created first.
    • No test report generators appear in the New Report dialog.
    • Report Icon is incorrect for Test Pass and Time Frame Historic
    • Test Report reports the last test execution only
    • Generate Report: Test Navigator does not refresh to show new report
    • TVT:PRT70_CHT_Duplicate mnemonics
    • (Usability) Missing/inconsistent titles/descriptions/icons in test report dialogs.
    • Unable to load file /Test/ejb2.testsuite during test generation
    • System default browser is not used as the default browser for URL recording.
    • Recorder Control view is not opened or has focus when a recording is started

• This Week:
  • 4.5 I7 TP1.
  • Defects:
    • Running a test linked to a datapool cause Severe Error
    • HTML Test Report Generation fails - MalformedURLException: unknown protocol: d
    • Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.
    • Technical review of Test Project documentation before 4.5 release

Duwayne

• Last Week:
  • Integrated community patches for:
    • Difficulties recording a session in Linux: the order/reporting of SWT events on Linux seems to be different than in Windows.
    • Certain characters in text on Button causes recorded script not playable
    • Continuous single selection in List/Table/Tree cannot be recorded correctly
    • Redundant dependency on org.eclipse.ui.testing
    • Redundant message to STDOUT when execute in quick mode
  • Resolved defect:
    • Command Line Execution - overwrite = True flag does not actually overwrite the results: Resolved (WORKSFORME).
  • Worked on defect Cannot remove a test invocation to a removed HTTP request.
  • Product testing of TPTP M5.

• This Week:
  • 4.5 I7 TP1.
  • Defects:
    • Exception when canceling a recording (before "recording "actually starts)
    • Cannot remove a test invocation to a removed HTTP request.
    • The invocation for some deleted testcases can't be removed in behaviour tab

Jerome

• Last Week:
  • Vacation: 2 days
  • Continued working on enhancement Move, Copy, Delete, Rename and Import/Export test assets.

• This Week:
  • Vacation: 4 days
  • Defect:
    • Unable to create proxy for testsuite
  • Close on enhancement Move, Copy, Delete, Rename and Import/Export test assets.

Tony

• Last Week:
  • Continued working on defect Accessibility-Need shortcuts for all Test Navigator pulldowns.

• This Week:
  • 4.5 I7 TP1:
  • Test with P2 Equinox.

Action items

• None.

Notes

• None.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.