TPTP-Test-Tools-20080407

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Tony Wang
  • Jerome Bozier

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• We are in first week of two weeks for I7 development (target: April 18).

News Group

• We have a backlog of news group posts that require a reply. Please work this week at replying to the posts for your component.

Testing

• Testing is complete (see the 4.5 I6 TP1 report.

• We have two critical defects:
  • Regression, Test Execution Fails: Local and remote test execution using the IAC and Agent Controller times out for all platforms. This defect is a regression from 4.5 I5 so required for 4.5 I6. Duwayne is working on a fix.
  • sun.io.MalformedInputException when deleting a test asset in the Test Navigator.: A

MalformedInputException is thrown when deleting a test asset in the Test Navigator on Linux. The delete operation must be aborted and the test asset is not deleted. This defect is a regression from 4.5 I5. Jerome is working on reproducing and finding the root cause of the problem. Since there is no fix in place, there is a work-around, and limited to Linux, we added a release note for I6 (see https://bugs.eclipse.org/bugs/show_bug.cgi?id=225827) and deferring to I7.

• We are impacted from the following critical Platform Project defects:
  • Regression, test execution on Vista crashes the AC
  • (Vista) File paths are too long when unzipping all-in-one.

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defect against the Test Project include:
    • Paul:
      • AGR Tests require absolute path to Equinox JAR
      • Clear remote workspace launch does not work for remote test execution
      • AGR Tests cannot be run with start ACServer
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests
      • Content missing in Tabular Report
      • Connection property does not deploy all dependencies
      • Connection property does not allow JUnit Plug-in Tests to be executed
    • Duwayne:
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • ANT importExistingProjects throws Exception

Enhancements

• Queries.
• Schedule.

• Jerome:
  • Move, Copy, Delete, Rename and Import/Export test assets: Paul reviewed and integrated the final patch. Jerome is continuing on the test cases and documentation.

• Alexander Nyßen:
  • Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. AG/PMC approval has been received and Paul will open a Contribution Questionnaire (CQ) this week for the contribution.

Defects

• Queries.

• Schedule.

• Bugzilla Prefix Legend:
  • [Product]: Defects required by consuming products.
  • [APAR]: Defects required by consuming products for customer support.

• The following candidate P1 defects/enhancements have been approved and deferred to I7 and future:
  • Candidate Defects

• Require sizings:
  • Duwayne:
    • Command Line Execution - overwrite = True flag does not actually overwrite the results
    • (Product) No data is recorded when recording after a hung/cancelled test execution.
    • Regrssion, Test Execution Fails
  • Jerome:
    • sun.io.MalformedInputException when deleting a test asset in the Test Navigator.

• Regressions:
  • Duwayne:
    • Regression, Test Execution Fails
  • Jerome:
    • sun.io.MalformedInputException when deleting a test asset in the Test Navigator.

• [APAR]:
  • Platform Project:
    • (APAR) Test Infrastructure doesn't work in firewalled environment
    • (APAR) Repeated launch through Automated Services Framework eventually fails
  • Paul:
    • (APAR) UI allows to launch non-profilable tests in profile mode.

• [Product]:
  • Duwayne:
    • (Product) Consumming Product: ASF Throws Modal Dialog Box.
    • (Product) Cannot remove a test invocation to a removed HTTP request.
    • (Product) HTTP recording does not work with Internet Explorer 7 and Firefox 2.0
    • (Product) Recorder launch wizard does not allow spaces
  • Jerome:
    • (Product) copy/paste of a simple folder does not work in Test Navigator view
    • (Product) Usability - adding existing artifacts/locations to deployment should select by name (not filename)
    • (Product) Test assets' editors (locations, datapools etc) allow save with empty internal names
  • Paul:
    • (Product) Generate Report: Test Navigator does not refresh to show new report
    • (Product) scroll bars not appearing when needed in test suite editor and other Hyades
    • (Product) Test Log Viewer: Link to deployment is displayed when using temp deploy not named 'default'
    • (Product) Location does not contain port number.

editors when content doesn't all fit in a page]

• • • (Product) (Usability) HTTP tests do not automatically generate JUnit Java code like JUnit tests.
    • (Product) Test editors: links to test elements don't do highlighting anymore
    • (Product) (Usability) creating TPTP test but you need to have parent project created first.
    • (Product) doc updates for section Creating a test deployment
    • (Product) what does the synchronous option mean for an invocation behavior in a JUnit Test Suite?
    • (Product) Time Frame Historical Report view does not have tabs and is missing info
    • (Product) variables are listed twice in the "EquivalenceClass" pane of Datapool
    • (Product) Context sensitive help requires refactoring and new content.
    • (Product) Unmovable rows in Datapool Editor
  • Tony:
    • (Product) Accessibility-Need shortcuts for all Test Navigator pulldowns

Round-table

Paul

• Last Week:
  • 4.5 I6 TP1
  • Resolved defects:
    • (Web) (Linux) Cannot not delete test assets in the Test Navigator.
    • Can not load datapool file while running a Juint test
    • No test report generators appear in the New Report dialog.

• This Week:
  • • (APAR) UI allows to launch non-profilable tests in profile mode.
    • (Product) Generate Report: Test Navigator does not refresh to show new report
    • (Product) scroll bars not appearing when needed in test suite editor and other Hyades
    • (Product) Test Log Viewer: Link to deployment is displayed when using temp deploy not named 'default'
    • (Product) Location does not contain port number.

editors when content doesn't all fit in a page]

• • • (Product) (Usability) HTTP tests do not automatically generate JUnit Java code like JUnit tests.

Duwayne

• Last Week:
  • 4.5 I6 TP1
  • Triaged Regression, Test Execution Fails.

• This Week:
  • Regression, Test Execution Fails.
  • (Product) Consumming Product: ASF Throws Modal Dialog Box.
  • (Product) Cannot remove a test invocation to a removed HTTP request.
  • (Product) HTTP recording does not work with Internet Explorer 7 and Firefox 2.0
  • (Product) Recorder launch wizard does not allow spaces

Jerome

• Last Week:
  • Triaged sun.io.MalformedInputException when deleting a test asset in the Test Navigator.

• This Week:
  • sun.io.MalformedInputException when deleting a test asset in the Test Navigator.
  • https://bugs.eclipse.org/bugs/show_bug.cgi?id=166025 Move, Copy, Delete, Rename and Import/Export test assets]:
    • Execution History viewer does not reload associated Test Suite when its resource changes
    • Provide error handling for corrupt/incomplete test assets.
    • (Test Naviagtor) Copy, Move, Rename, Delete should be optional

Tony

• Last Week:
  • 4.5 I6 TP1
  • Resolved defect:
    • Test.Execution.JUnitRunner.testsuite and Test.Execution.JUnitRunner.Bug186196.testsuite are failing.

• This Week:
  • (Product) Accessibility-Need shortcuts for all Test Navigator pulldowns

Action items

• None.

Notes

• None.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.