TPTP-Test-Tools-20080303

Attendees

• Present:
  • Paul Slauenwhite
  • Jerome Bozier
  • DuWayne Morris
  • Tony Wang

4.4.1

Release Information

• 4.4.1 will ship with the Europa Winter Maintenance Release (target release date: February 29, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• The Release Engineering has dropped the candidate driver to Europa today.

• The TPTP 4.4.1 release is now publicly available.

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• We are in the third week (of four weeks) of I6 development (target: March 14).

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defect against the Test Project include:
    • Paul:
      • Running ASF through Ant requires display export: Fixed in I6.
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests
      • Content missing in Tabular Report
      • Connection property does not deploy all dependencies
      • Connection property does not allow JUnit Plug-in Tests to be executed
    • Duwayne:
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • ANT importExistingProjects throws Exception

Enhancements

• Queries.
• Schedule.

• Xin Ying Huang:
  • Encrypted datapool variable support: Paul and Xin and dialogging on refactoring the patch. Xin is also writing the test cases and documentation for the enhancement.

• Duwayne:
  • Test execution should support parallel execution of tests: Duwayne chaired a call last week to discuss the progress and outstanding items (see the meeting minutes). The implementation is complete and Duwayne is not enhancing the thread synchronization code (target: Wednesday). Duwayne has opened defect 221150 to externalize strings in the org.eclipse.hyades.execution plug-in.

• Jerome:
  • Move, Copy, Delete, Rename and Import/Export test assets: Paul reviewed the attached patch file and Jerome refined the patch file. Paul will review again today. Jerome will continue on refining the implementation.

• Paul:
  • Generic Recorder Wizard enhancement to filter the list of recorders: Paul is continued on the implementation/testing.

• Alexander Nyßen:
  • Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. Paul has reviewed the patch and is proceeding with AG/PMC approval before opening a Contribution Questionnaire (CQ) for the contribution.

Defects

• Queries.

• Schedule.

• Bugzilla Prefix Legend:
  • [Product]: Defects required by consuming products.
  • [APAR]: Defects required by consuming products for customer support.

• [APAR]:
  • I6:
    • (APAR) Repeated launch through Automated Services Framework eventually fails: Problem is the result of a handle leak (e.g. 50+ handle leaks per test execution in 4.2.2 so for ~75 test executions, the total number of handles is ~3800) by the Agent Controller and blocked communication between the client and Comptest Agent. This defect has been transfered to the Platform Project for completion in I6. Duwayne updated the defect with his findings, hours worked and a test case to reproduce the symptoms.
    • (APAR) UI allows to launch non-profilable tests in profile mode.

• [Product]:
  • I6:
    • (Product) Accessibility-Need shortcuts for all Test Navigator pulldowns
    • (Product) Allow programmatic context for initially selected project in Generic Recorder Wizard
    • (Product) Cannot remove a test invocation to a removed HTTP request.
    • (Product) copy/paste of a simple folder does not work in Test Navigator view
    • (Product) Copying lots of test results to a newly created folder hangs the system
    • (Product) HTTP Recorder does not function if TMP dir does not exist
    • (Product) intermittently see start and stop recording problems
    • (Product) Report Icon is incorrect for Test Pass and Time Frame Historic
    • (Product) scroll bars not appearing when needed in test suite editor and other Hyades editors when content doesn't all fit in a page
    • (Product) Test Log Viewer: Link to deployment is displayed when using temp deploy not named 'default'
    • (Product) Unmovable rows in Datapool Editor
    • (Product) variables are listed twice in the "EquivalenceClass" pane of Datapool
    • (Product) (Usability) creating TPTP test but you need to have parent project created first.
  • I7:
    • (Product) what does the synchronous option mean for an invocation behavior in a JUnit Test Suite?
    • (Product) Consumming Product: ASF Throws Modal Dialog Box.
    • (Product) Context sensitive help requires refactoring and new content.
    • (Product) doc updates for section Creating a test deployment
    • (Product) Generate Report: Test Navigator does not refresh to show new report
    • (Product) HTTP recording does not work with Internet Explorer 7 and Firefox 2.0
    • (Product) Recorder launch wizard does not allow spaces
    • (Product) Test assets' editors (locations, datapools etc) allow save with empty internal names
    • (Product) Time Frame Historical Report view does not have tabs and is missing info
    • (Product) Usability - adding existing artifacts/locations to deployment should select by name (not filename)
    • (Product) (Usability) HTTP tests do not automatically generate JUnit Java code like JUnit tests.

I6 Defect Schedule

• February 25 - February 29:
  • Duwayne:
    • (APAR) Repeated launch through Automated Services Framework eventually fails: Moved to the Platform Project
    • Test execution should support parallel execution of tests: SLIPPED
  • Jerome:
    • Move, Copy, Delete, Rename and Import/Export test assets.: SLIPPED
  • Paul K.:
    • (Product) Accessibility-Need shortcuts for all Test Navigator pulldowns: SLIPPED
  • Tony:
    • API Recorder's Generate Test Suite dialog does not select a default selection.: COMPLETE
    • (Usability) Switch to Test Perspective after creating a test asset.: COMPLETE
  • Paul:
    • Generic Recorder Wizard enhancement to filter the list of recorders: SLIPPED
    • Vista-specific error dialog when recording using IAC/IE on XP.: COMPLETE
    • Importing large datapool freezes wizard.: SLIPPED
    • Remove references to internal APIs.: SLIPPED
    • Exported datapool with deleted variables is incorrect.: SLIPPED
    • Cannot import HTTP recording file.: SLIPPED
    • Running ASF through Ant requires display export: COMPLETE
    • Duplicate wizards for creating a URL recording/test.: SLIPPED
    • Reinstate features and 'empty' plug-ins for as-is components.: COMPLETE
• March 3 - March 7:
  • Duwayne:
    • (Product) HTTP Recorder does not function if TMP dir does not exist
    • (Product) Allow programmatic context for initially selected project in Generic Recorder Wizard
  • Jerome:
    • (Product) Copying lots of test results to a newly created folder hangs the system
    • (Product) copy/paste of a simple folder does not work in Test Navigator view
    • Adding a location or artifact with a duplicate name of a removed resource in a deployment does not work
    • Filename vs. logical name in UI
  • Paul K.:
    • (Product) scroll bars not appearing when needed in test suite editor and other Hyades editors when content doesn't all fit in a page
    • Log Viewer : navigation button on event part of test log are not enabled by default
  • Tony:
    • (Usability) Switch to Test Perspective after test execution.
    • (Usability) Test Log view does not open after a test execution has completed.
    • (Usability) Missing/inconsistent titles/descriptions/icons in test report dialogs.
  • Paul:
    • Document, publicize and remove deprecated classes/APIs.
    • (Product) Test Log Viewer: Link to deployment is displayed when using temp deploy not named 'default'
    • Test Tools documentation I5 smoke test failures.
    • Test.Execution.JUnitRunner.testsuite and Test.Execution.JUnitRunner.Bug186196.testsuite are failing.
    • (Product) (Usability) creating TPTP test but you need to have parent project created first.
    • (Usability) Provide option to open Test Perspective after creating test assets.
    • (APAR) UI allows to launch non-profilable tests in profile mode
    • Generic recorder wizard forbids customization of the Location page
    • Location does not contain port number.
    • (Vista) Windows informational dialog when generating JScrib test reports.
• March 10 - March 14:
  • Duwayne:
    • (Product) intermittently see start and stop recording problems
    • NullPointerException when requesting publication of AGR test results from Ant script
    • URL Recorder operational messages require cleanup.
    • (Product) Cannot remove a test invocation to a removed HTTP request.
    • non-externalized strings in org.eclipse.hyades.execution
  • Jerome:

(Not working on TPTP)

• • Paul K.:
    • (Product) Unmovable rows in Datapool Editor
  • Tony:
    • (Product) Report Icon is incorrect for Test Pass and Time Frame Historic
    • Deprecate JScrib and JScrib report generators.
  • Paul:
    • Encrypted datapool variable support
    • Providing the ability to record user's interactions with GEF objects in a GEF editor
    • Update copyright dates and translatability errors.
    • (Product) variables are listed twice in the "EquivalenceClass" pane of Datapool
    • (Usability) Verdict Summary BIRT chart in Test Log viewer displays 0%.
    • JUnit/Plug-in tests do not allow plugin root as source folder.
    • (Usability) .execution files should give more informative statistics
    • Remove XMLUnit dependency and convert reporting tests to TPTP tests.
    • (Usability) Hyperlinks in Test Log view are rendered differently for the Test Execution event type.
    • Move JUnit Plug-in test tools documentation to a separate plug-in.
    • Need new icon for testlog files
    • Datapools are not portable.
    • Clean-up the TPTP committer lists and project matrix.
    • Removing an Artifact Location Pair returns a Null Pointer Exception
    • Adding a location or artifact with a duplicate name of a removed resource in a deployment does not work
    • Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.

Miscellaneous

• (Scalability) Address TPTP EMF model scalability problems: Although withdrawn as a 4.5 candidate enhancement, the outcome/status of the work done in 4.4 on this enhancement was not updated in the WIKI page. Joe will update the WIKI.

• Test project topics for upcoming AG calls include:
  • ASF and Test Services: Joe
  • Test automation initiative: Alan/Joel/Paul

Round-table

Paul

• Last Week:
  • Finalizing the I6 defect list and schedule.
  • Code/UI reviewed Move, Copy, Delete, Rename and Import/Export test assets.
  • Resolved defects:
    • 161508 (Project) Inability to extend the hyperlink
    • 170800 Leverage/integrate EMMA for line level code coverage of TPTP's Java code.
    • 184270 Move JUnit Plug-in test tools documentation to a separate plug-in.
    • 189128 Vista-specific error dialog when recording using IAC/IE on XP.
    • 202269 Details page extension does not show any properties.
    • 214671 (Usability) Provide option to open Test Perspective after creating test assets.
    • 215236 (Usability) Logical and physical names for test assets is confusing.
    • 216635 Running ASF through Ant requires a display.
    • 218035 Update copyright dates and translatability errors.

• This Week:
  • Defects.
  • Enhancements:
    • Generic Recorder Wizard enhancement to filter the list of recorders.
  • Finish reviewing Move, Copy, Delete, Rename and Import/Export test assets.

Duwayne

• Last Week:
  • Closed on defect (APAR) Repeated launch through Automated Services Framework eventually fails and moved it to the Platform Project.
  • Duwayne chaired a call last week to discuss the progress and outstanding items (see the meeting minutes).
  • The implementation is complete and Duwayne is not enhancing the thread synchronization code (target: Wednesday).
  • Worked on defect (Product) HTTP Recorder does not function if TMP dir does not exist

• This Week:
  • Assisting a consuming product with diagnosing a firewall issue when launching tests.
    • Will open a TPTP defect if the issue is in TPTP code.
  • Defects.
  • Enhancements:
  • Test execution should support parallel execution of tests.

Jerome

• Last Week:
  • Fixed problem with patch file for enhancement Move, Copy, Delete, Rename and Import/Export test assets.
  • Triaged defect (Product) Copying lots of test results to a newly created folder hangs the system and could not reproduce with patch file for enhancement Move, Copy, Delete, Rename and Import/Export test assets.

• This Week:
  • Defects.
  • Enhancements:
    • Move, Copy, Delete, Rename and Import/Export test assets.

Tony

• Last Week:
  • Resolved defects:
    • (Usability) Switch to Test Perspective after creating a test asset.
    • API Recorder's Generate Test Suite dialog does not select a default selection.

• This Week:
  • Defects.

Notes

EclipseCon 2008

• Test and Performance Category.
• Test and Performance Presentations

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.