TPTP-Test-Tools-20080121

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Jerome Bozier
  • Tony Wang

4.4.1

Release Information

• 4.4.1 will ship with the Europa Winter Maintenance Release (target release date: February 29, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

• All defects will require project/PMC approval.

• All fixes MUST be checked-in to both 4.4.1 (TPTP-4_1_1) and 4.5 (HEAD) streams.

Testing

• The 4.4.1 test pass (TP) starts on next Monday (January 28) for two weeks (see Detailed Schedule).
  • Tony is completing the Windows testing as part of his orientation.
  • Lead committers will have to complete multi-platform and Linux testing for the TP.

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• We are currently in last week of development for 4.5 I5 (target: January 25).

Testing

• Since the 4.4.1 TP overlaps with the 4.5 I5 TP1 (see 4.4.1 Detailed Schedule and 4.5 Detailed Schedule) and there have been sufficient fixes integrated into 4.4.1 to merit a full test pass, we will:
  • Not complete 4.5 I5 TP1 to focus on the 4.4.1 TP.
  • Start the 4.5 I5 TP2 when the 4.4.1 TP is complete.
  • Complete a full test pass for 4.5 I5 TP2.

• For the Test Project, we can extend I5 development to February 6 by attaching patches to the Bugzilla AFTER I5 development ends on January 25.

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • Outstanding defect against the Test Project include:
    • Paul:
      • Deploying junit plug-in test to remote Windows machine from a Linux machine fails: Completed in i5.
      • Test log not accurate: Targeted to i5.
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests: Targeted to i5.
      • OutOfMemoryError when generating large TPTP test reports: Targeted to i5.
      • Content missing in Tabular Report: Targeted to i6.
    • Duwayne:
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results: Targeted to i6.
      • ANT test results property requires trailing slash to specify location: Targeted to i6.
      • ANT importExistingProjects throws Exception: Targeted to i6.
      • publication task problems: Targeted to i6.

Enhancements

• Queries.
• Schedule.

• Xin Ying Huang:
  • Encrypted datapool variable support: The implementation is complete. Paul and Joe will complete a code review over the next two weeks.

• Duwayne:
  • Test execution should support parallel execution of tests: See the meeting minutes for more details. Duwayne will complete this enhancement in I5/I6 development. The test cases and product documentation will be complete in I5 TPs and I6 development. This past week, Duwayne found non-thread-safe code in the Hyades execution APIs causing exceptions when extracting data from RMI calls. Will consult Joe and Scott for any history on this area of the code.

• Jerome:
  • Move, Copy, Delete, Rename and Import/Export test assets: See the meeting minutes for the design review. Jerome chaired a call to discuss the final design decisions. See the meeting minutes for more details, including the core use cases and action items. Jerome completed the Detailed Design Document and is currently working on the engine work.

• Paul:
  • Generic Recorder Wizard enhancement to filter the list of recorders: Paul has closed on the design with the originator (see meeting minutes) and will complete the implementation/testing in I5.

Defects

• Queries.
• Schedule.

• Remaining I5 defects:
  • Paul:
    • Remove references to internal APIs.
    • Exported datapool with deleted variables is incorrect.
    • Importing large datapool freezes wizard.
    • Test log not accurate
    • OutOfMemoryError when generating large TPTP test reports.
    • Incorrect german translation of the word "Pass"
    • Simplified Chinese translation when editing a datapool is incorrect
    • Malformed report window time stamps in the report wizard.
    • Confusing label in Test preferences.
    • Remove the "open editor" button on the Report Wizard first page
    • Need new icon for testlog files
    • scroll bars not appearing when needed in test suite editor and other Hyades editors when content doesn't all fit in a page
    • Add help icon to Report Wizard
    • Formatting messages make translation difficult.
    • (Usability) Switch to Test Perspective after test execution.
    • (Usability) Switch to Test Perspective after creating a test asset.
    • (Testing Tool) Invalid characters inserted in source folder textbox when using Browse button of "Generate..." menu item
    • Copy / Paste should not be available in the logical test navigator
    • (Usability) Missing/inconsistent titles/descriptions/icons in test report dialogs.
    • (Usability) Test invocation error message cannot be copied
    • Log Viewer : navigation button on event part of test log are not enabled by default
    • TPTP test pass reports show test type ID instead of meaningful name.
    • (Usability) Hyperlinks in Test Log view are rendered differently for the Test Execution event type.
    • Report Icon is incorrect for Test Pass and Time Frame Historic
    • Remove XMLUnit dependency and convert reporting tests to TPTP tests.
  • Duwayne:
    • Vista-specific error dialog when recording using IAC/IE on XP.
    • ASF marshalling return value between service and client adapter does not have support for failures / exceptions
    • Get rid of the Remove option from the Http Requests tab of the Hyades URL Test Suite
    • Text in Recorder Control should be copyable.
    • Repeated launch through Automated Services Framework eventually fails
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.
    • RecorderException when HTTP recording with Internet Explorer on Windows XP.
  • Kendric:
    • (Linux) AGR test suite does not run.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.

Miscellaneous

• (Scalability) Address TPTP EMF model scalability problems: Although withdrawn as a 4.5 candidate enhancement, the outcome/status of the work done in 4.4 on this enhancement was not updated in the WIKI page. Joe will update the WIKI.

• Test project topics for upcoming AG calls include:
  • Enhancement Move, Copy, Delete, Rename and Import/Export test assets: Jerome.
  • Test automation initiative: Alan/Joel
  • EMMA: Paul

Round-table

Paul

• Last Week:
  • Reviewed the Detailed Design Document for enhancement Move, Copy, Delete, Rename and Import/Export test assets.
  • Completed defects:
    • (Web Doc) Local and remote Eclipse instances must be the same version when running remote JUnit Plug-in test suites remotely.
    • Fix 4.4.1 copyright and translatability errors in build report
    • Deploying junit plug-in test to remote Windows machine from a Linux machine fails
    • Problems in displaying Hebrew (Bi-Directional) text in the TPTP Log Viewer
    • Provide a TPTP icon for Ganymede.
    • Remove unused import statements.

• This Week:
  • Enhancement:
    • Generic Recorder Wizard enhancement to filter the list of recorders.
  • Defects:
    • Remove references to internal APIs.
    • OutOfMemoryError when generating large TPTP test reports.
    • Importing large datapool freezes wizard.
    • Exported datapool with deleted variables is incorrect.
    • Test log not accurate
    • Incorrect german translation of the word "Pass"
    • Malformed report window time stamps in the report wizard.
    • Confusing label in Test preferences.
    • Remove the "open editor" button on the Report Wizard first page
    • Add help icon to Report Wizard
    • Formatting messages make translation difficult.
    • (Testing Tool) Invalid characters inserted in source folder textbox when using Browse button of "Generate..." menu item
    • Simplified Chinese translation when editing a datapool is incorrect
    • Remove XMLUnit dependency and convert reporting tests to TPTP tests: Targeted to i5.

Duwayne

• Last Week:
  • Working on enhancement Test execution should support parallel execution of tests including investigating sequence of events and setting up a test environment for multiple agents.

• This Week:
  • Enhancement:
    • Test execution should support parallel execution of tests.
  • Defect:
    • RecorderException when HTTP recording with Internet Explorer on Windows XP.

Jerome

• Last Week:
• Working on enhancement Move, Copy, Delete, Rename and Import/Export test assets.
  • Completed the Detailed Design Document.

• This Week:
  • Enhancement:
    • Move, Copy, Delete, Rename and Import/Export test assets.
      • Schedule a follow-on call/demo.

Tony

• Last Week:
  • Reviewed TPTP processes and Testing Tools documentation.
  • Running 4.4.1 test suites on Windows.

• This Week:
  • Complete running 4.4.1 test suites on Windows.

Action items

Jerome

• Schedule a follow-on call/demo for enhancement Move, Copy, Delete, Rename and Import/Export test assets.

Notes

News

• Jerome was elected by the Committers and approved by the PMC as a Committer on the TPTP Testing Tools project.
  • Jerome will fill out the Member Committer Questionnaire to complete the process.
  • Jerome G. will nominate Jerome as the lead committer for the following components by sending an email to the Testing Tools mailing list:
    • Test.UI
    • Test.UI.ConfigEditors
    • Test.UI.DatapoolEditor
    • Test.UI.FrameworkEditors
    • Test.UI.TestPerspective

EclipseCon 2008

• Test and Performance Category.
• Test and Performance Presentations

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.