TPTP-Test-Tools-20080407

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Tony Wang
  • Jerome Bozier

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• We are in first week of two weeks for I7 development (target: April 18).

News Group

• We have a backlog of news group posts that require a reply. Please work this week at replying to the posts for your component.

Testing

• Testing is complete (see the 4.5 I6 TP1 report.

• We have two critical defects:
  • Regression, Test Execution Fails: Local and remote test execution using the IAC and Agent Controller times out for all platforms. Caused by waiting for the agent to execute but the agent terminated execution due to a missing resource bundle class introduced by the recent defect to externalize strings in org.eclipse.hyades.execution. This defect is a regression from 4.5 I5. Duwayne is working on reproducing and finding the root cause of the problem. Since there is no fix in place we had to add a release note for I6 (see (Web) Test execution periodically hangs) and deferred to I7.
  • sun.io.MalformedInputException when deleting a test asset in the Test Navigator: A MalformedInputException is thrown when deleting a test asset in the Test Navigator on Linux. The delete operation must be aborted and the test

asset is not deleted. This defect is a regression from 4.5 I5. Jerome is working on reproducing and finding the root cause of the problem. Since there is no fix in place, there is a work-around, and limited to Linux, we added a release note for I6 (see (Web) (Linux) Cannot not delete test assets in the Test Navigator.) and deferred to I7.

• We are impacted from the following critical Platform Project defects:
  • Regression, test execution on Vista crashes the AC

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defect against the Platform Project include:
    • Execution of any testsuite fails using the IAC - InactiveProcessException
  • Outstanding defect against the Test Project include:
    • Paul:
      • AGR Tests require absolute path to Equinox JAR
      • Clear remote workspace launch does not work for remote test execution
      • AGR Tests cannot be run with start ACServer
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests
      • Content missing in Tabular Report
      • Connection property does not deploy all dependencies
      • Connection property does not allow JUnit Plug-in Tests to be executed
    • Duwayne:
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • ANT importExistingProjects throws Exception

Enhancements

• Queries.
• Schedule.

• Jerome:
  • Move, Copy, Delete, Rename and Import/Export test assets: Paul reviewed and integrated the final patch. Jerome is continuing on the test cases and documentation. Dependent defects:
    • Filename vs. logical name in UI
    • Adding a location or artifact with a duplicate name of a removed resource in a deployment does not work.

• Alexander Nyßen:
  • Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. AG/PMC approval has been received and Paul will open a Contribution Questionnaire (CQ) this week for the contribution.

Defects

• Queries.

• Schedule.

• Bugzilla Prefix Legend:
  • [Product]: Defects required by consuming products.
  • [APAR]: Defects required by consuming products for customer support.

• The following candidate P1 defects/enhancements have been approved and deferred to I7 and future:
  • Candidate Defects

• Require sizings:
  • Duwayne:
    • Command Line Execution - overwrite = True flag does not actually overwrite the results
    • (Product) No data is recorded when recording after a hung/cancelled test execution.
    • Regrssion, Test Execution Fails
  • Jerome:
    • sun.io.MalformedInputException when deleting a test asset in the Test Navigator.

• Regressions:
  • Duwayne:
    • Regression, Test Execution Fails
  • Jerome:
    • sun.io.MalformedInputException when deleting a test asset in the Test Navigator.

• [APAR]:
  • Platform Project:
    • (APAR) Test Infrastructure doesn't work in firewalled environment
    • (APAR) Repeated launch through Automated Services Framework eventually fails
  • Paul:
    • (APAR) UI allows to launch non-profilable tests in profile mode.

• [Product]:
  • Duwayne:
    • (Product) Consumming Product: ASF Throws Modal Dialog Box.
    • (Product) Cannot remove a test invocation to a removed HTTP request.
    • (Product) HTTP recording does not work with Internet Explorer 7 and Firefox 2.0
    • (Product) Recorder launch wizard does not allow spaces
  • Jerome:
    • (Product) copy/paste of a simple folder does not work in Test Navigator view
    • (Product) Usability - adding existing artifacts/locations to deployment should select by name (not filename)
    • (Product) Test assets' editors (locations, datapools etc) allow save with empty internal names
  • Paul:
    • (Product) Generate Report: Test Navigator does not refresh to show new report
    • (Product) scroll bars not appearing when needed in test suite editor and other Hyades
    • (Product) Test Log Viewer: Link to deployment is displayed when using temp deploy not named 'default'
    • (Product) Location does not contain port number.
    • (Product) (Usability) HTTP tests do not automatically generate JUnit Java code like JUnit tests.
    • (Product) Test editors: links to test elements don't do highlighting anymore
    • (Product) (Usability) creating TPTP test but you need to have parent project created first.
    • (Product) doc updates for section Creating a test deployment
    • (Product) what does the synchronous option mean for an invocation behavior in a JUnit Test Suite?
    • (Product) Time Frame Historical Report view does not have tabs and is missing info
    • (Product) variables are listed twice in the "EquivalenceClass" pane of Datapool
    • (Product) Context sensitive help requires refactoring and new content.
    • (Product) Unmovable rows in Datapool Editor
  • Tony:
    • (Product) Accessibility-Need shortcuts for all Test Navigator pulldowns

Round-table

Paul

• Last Week:
  • 4.5 I6 TP1
  • Resolved defects:
    • (Web) (Linux) Cannot not delete test assets in the Test Navigator.
    • Can not load datapool file while running a Juint test
    • No test report generators appear in the New Report dialog.

• This Week:
  • • (APAR) UI allows to launch non-profilable tests in profile mode.
    • (Product) Generate Report: Test Navigator does not refresh to show new report
    • (Product) scroll bars not appearing when needed in test suite editor and other Hyades
    • (Product) Test Log Viewer: Link to deployment is displayed when using temp deploy not named 'default'
    • (Product) Location does not contain port number.
    • (Product) (Usability) HTTP tests do not automatically generate JUnit Java code like JUnit tests.

Duwayne

• Last Week:
  • 4.5 I6 TP1
  • Triaged Regression, Test Execution Fails.

• This Week:
  • Regression, Test Execution Fails.
  • (Product) Consumming Product: ASF Throws Modal Dialog Box.
  • (Product) Cannot remove a test invocation to a removed HTTP request.
  • (Product) HTTP recording does not work with Internet Explorer 7 and Firefox 2.0
  • (Product) Recorder launch wizard does not allow spaces

Jerome

• Last Week:
  • Vacation: 1 day.
  • Triaged sun.io.MalformedInputException when deleting a test asset in the Test Navigator.

• This Week:
  • sun.io.MalformedInputException when deleting a test asset in the Test Navigator.
  • (Product) copy/paste of a simple folder does not work in Test Navigator view
  • Move, Copy, Delete, Rename and Import/Export test assets:
    • Filename vs. logical name in UI
    • Adding a location or artifact with a duplicate name of a removed resource in a deployment does not work

Tony

• Last Week:
  • 4.5 I6 TP1
  • Resolved defect:
    • Test.Execution.JUnitRunner.testsuite and Test.Execution.JUnitRunner.Bug186196.testsuite are failing.

• This Week:
  • (Product) Accessibility-Need shortcuts for all Test Navigator pulldowns
  • Testing:
    • Java 6.
    • P2 Equinox

Action items

• None.

Notes

• None.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.