TPTP-Test-Tools-20080225

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Tony Wang
  • Jerome Bozier

4.4.1

Release Information

• 4.4.1 will ship with the Europa Winter Maintenance Release (target release date: February 29, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• We have completed 4.4.1 TP2 testing of candidate driver.

• Release Engineering will drop the candidate driver to Europa today.

Defects

• Critical:
  • BIRT Test Reports do not contain any content: Fixed by BIRT defect Data source is not used during report generation.

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• We are in the second week (of four weeks) of I6 development (target: March 14).

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • Outstanding defect against the Test Project include:
    • Paul:
      • Running ASF through Ant requires display export: Currently blocking BVTs.
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests
      • Content missing in Tabular Report
      • Connection property does not deploy all dependencies
      • Connection property does not allow JUnit Plug-in Tests to be executed
    • Duwayne:
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • ANT importExistingProjects throws Exception

Enhancements

• Queries.
• Schedule.

• Xin Ying Huang:
  • Encrypted datapool variable support: The implementation is complete. Paul completed the code review and Xin is refactoring the patch. Xin is also writing the test cases and documentation for the enhancement.

• Duwayne:
  • Test execution should support parallel execution of tests: Duwayne will schedule a call for tomorrow/Wednesday to discuss the progress and outstanding items.

• Jerome:
  • Move, Copy, Delete, Rename and Import/Export test assets: Jerome completed the implementation (except the error handling use case, which will be deferred to a future release). Paul will review the attached patch file today for Jeorme to continue on refining the implementation.

• Paul:
  • Generic Recorder Wizard enhancement to filter the list of recorders: Paul has closed with the consuming product on removing the duplicate HTTP recording wizard (see defect 137591) and wizard to import HTTP recordings (see [https://bugs.eclipse.org/bugs/show_bug.cgi?id=206078 defect 206078) since both are currently supported by the GRF. Paul will complete the implementation/testing this week.

• Alexander Nyßen:
  • Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. Paul has reviewed the patch and is proceeding with AG/PMC approval before opening a Contribution Questionnaire (CQ) for the contribution.

Defects

• Queries.

• Schedule.

• We will start using the following prefixes to Bugzilla summaries:
  • [Product]: Defects required by consuming products.
  • [APAR]: Defects required by consuming products for customer support.

• [APAR]:
  • Duwayne:
    • (APAR) Repeated launch through Automated Services Framework eventually fails: Problem the result of a handle leak (e.g. 50+ handle leaks per test execution in 4.2.2 so for ~75 test executions, the total number of handles is ~3800) by the Agent Controller. Paul has scheduled a call for Wednesday to discuss with the Platform Project Lead.
  • Paul:
    • (APAR) UI allows to launch non-profilable tests in profile mode.

• [Product]:
  • Duwayne:
    • (Product) Allow programmatic context for initially selected project in Generic Recorder Wizard
  • Jerome:
    • (Product) copy/paste of a simple folder does not work in Test Navigator view
    • (Product) Usability - adding existing artifacts/locations to deployment should select by name (not filename)
    • (Product) Test assets' editors (locations, datapools etc) allow save with empty internal names
  • Paul:
    • (Product) Test Log Viewer: Link to deployment is displayed when using temp deploy not named 'default'
    • (Product) variables are listed twice in the "EquivalenceClass" pane of Datapool
    • (Product) Context sensitive help requires refactoring and new content.
  • Paul Klicnik:
    • (Product) Accessibility-Need shortcuts for all Test Navigator pulldowns
    • (Product) Unmovable rows in Datapool Editor

• Defects requiring a sizing:
  • Jerome:
    • Copying lots of test results to a newly created folder hangs the system
    • The five toolbar buttons in test log are disabled after click some verdicts in event tree
    • Wrong behaviour when using Working Sets in Test Navigator

• I6 defects:
  • Paul will finalize the I6 defect list and schedule today.
    • Paul will request a review of the I6 defect list and schedule today or tomorrow.

Miscellaneous

• (Scalability) Address TPTP EMF model scalability problems: Although withdrawn as a 4.5 candidate enhancement, the outcome/status of the work done in 4.4 on this enhancement was not updated in the WIKI page. Joe will update the WIKI.

• Test project topics for upcoming AG calls include:
  • ASF and Test Services: Joe
  • Test automation initiative: Alan/Joel/Paul

Round-table

Paul

• Last Week:
  • 4.4.1 TP2.
  • EclipseCon 2008 presentation slides.
  • Code/UI reviewed Encrypted datapool variable support.
  • Reviewing and moderating the code/documentation contribution for Providing the ability to record user's interactions with GEF objects in a GEF editor.
  • Tested the BIRT/DTP fixes for three defects blocking TPTP 4.4.1/4.5 I5 function.
  • Resolved defects:
    • TP JUnit Testing Stucks up @ 93%
    • AbstractRegressionTest.runNegativeTest(String , String) is running Junit tests twice
    • BIRT Test Reports do not contain any content.
    • TPTP Test report generation is very slow with a larger input stream.
    • Test Reports contain no data.

• This Week:
  • Finalizing the I6 defect list and schedule.
  • Defects:
    • Vista-specific error dialog when recording using IAC/IE on XP.
    • Importing large datapool freezes wizard.
    • Remove references to internal APIs.
    • Exported datapool with deleted variables is incorrect.
    • Cannot import HTTP recording file.
    • Running ASF through Ant requires display export
    • Duplicate wizards for creating a URL recording/test.
    • Reinstate features and 'empty' plug-ins for as-is components.
  • Enhancements:
    • Generic Recorder Wizard enhancement to filter the list of recorders.
  • Finish reviewing Move, Copy, Delete, Rename and Import/Export test assets.

Duwayne

• Last Week:
  • 4.4.1 TP2.
  • Defects:
    • [APAR Repeated launch through Automated Services Framework eventually fails]

• This Week:
  • Defects:
    • [APAR Repeated launch through Automated Services Framework eventually fails]
  • Enhancements:
  • Test execution should support parallel execution of tests.

Jerome

• Last Week:
  • No TPTP contribution.

• This Week:
  • Defects:
    • Copying lots of test results to a newly created folder hangs the system
  • Enhancements:
    • Move, Copy, Delete, Rename and Import/Export test assets.

Tony

• Last Week:
  • 4.4.1 TP2.
  • Trace Project testing.

• This Week:
  • Defects:
    • API Recorder's Generate Test Suite dialog does not select a default selection.
    • (Usability) Switch to Test Perspective after creating a test asset.
    • (Usability) Test Log view does not open after a test execution has completed.
    • (Usability) Missing/inconsistent titles/descriptions/icons in test report dialogs.
    • (Usability) Switch to Test Perspective after test execution.

Action items

Duwayne

• Schedule a call for tomorrow/Wednesday to discuss the progress and outstanding items for enhancement Test execution should support parallel execution of tests.

Paul

• Finalize the I6 defect list and schedule.

Notes

EclipseCon 2008

• Test and Performance Category.
• Test and Performance Presentations

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.