TPTP-Test-Tools-20080114

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Joe Toomey
  • Jerome Bozier

4.4.1

Release Information

• 4.4.1 will ship with the Europa Winter Maintenance Release (target release date: February 29, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

• All defects will require project/PMC approval.

• All fixes MUST be checked-in to both 4.4.1 (TPTP-4_1_1) and 4.5 (HEAD) streams.

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• We are currently in week two of three weeks of development for 4.5 I5 (target: January 25).

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • Outstanding defect against the Test Project include:
    • Paul:
      • IndexOutOfBoundsException thrown when running BVT junit test: Completed in i5.
      • BVT JUnit test does not run: Completed in i5.
      • Execution result of Monitor.Analysis.LogImport_Windows_IA32 is not showing up in the 4.5 i5 TP2 test report.: Completed in i5.
      • Deploying junit plug-in test to remote Windows machine from a Linux machine fails: Targeted to i5.
      • Test log not accurate: Targeted to i5.
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests: Targeted to i5.
      • OutOfMemoryError when generating large TPTP test reports: Targeted to i5.
      • Content missing in Tabular Report: Targeted to i6.
    • Duwayne:
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results: Targeted to i6.
      • ANT test results property requires trailing slash to specify location: Targeted to i6.
      • ANT importExistingProjects throws Exception: Targeted to i6.
      • publication task problems: Targeted to i6.

Enhancements

• Queries.
• Schedule.

• Xin Ying Huang:
  • Encrypted datapool variable support: The implementation is nearly complete. Paul and Joe are working closely with Xin Ying to answer design/implementation-specific questions and they will complete a code review in I5 development. The code is complete and Paul will conduct a code review this week. Joe will conduct a code review during the week of January 28 - February 1.

• Duwayne:
  • Test execution should support parallel execution of tests: See the meeting minutes for more details. Duwayne will complete this enhancement in I5 development. The test cases and product documentation will be complete in I5 TPs and I6 development. This past week, Duwayne was able to debug to the point that the agents come up in parallel on the remote machine but the client waits for some reason. He also found a RMI exception when the workbench calls the session JVM after it comes down.

• Jerome:
  • Move, Copy, Delete, Rename and Import/Export test assets: See the meeting minutes for the design review. Jerome chaired a call to discuss the final design decisions. See the meeting minutes for more details, including the core use cases and action items. Jerome ported the partial implementation provided by Jerome G. from TPTP 4.3.0 to TPTP 4.5.0. Jerome is working on the design of the copy/paste use case. Regarding physical versus logical renaming (benefit (if any) of the logical name for a test asset and determine if it could can be the same as the physical name), the logical resource name was created since all test resources extend from a common EMF class called org.eclipse.hyades.models.common.common.CMNNamedElement.java with ID, name, and description properties. There is no tangible benefit to keeping separate logical and physical names. The logical name can be replaced by the physical name by overriding the getName() to resolve the physical name of the resource and updating all of the editors to not allow the user edit the name of the resource (e.g. read-only). See defect Replace logical name with physical name for test assets for more details.

• Paul:
  • Generic Recorder Wizard enhancement to filter the list of recorders: Paul has closed on the design with the originator (see meeting minutes) and will complete the implementation/testing in I5.

Defects

• Queries.
• Schedule.

• Paul:
  • Remove references to internal APIs.
  • Exported datapool with deleted variables is incorrect.
  • Deploying junit plug-in test to remote Windows machine from a Linux machine fails
  • OutOfMemoryError when generating large TPTP test reports.
  • Problems in displaying Hebrew (Bi-Directional) text in the TPTP Log Viewer
  • Importing large datapool freezes wizard.
  • Test log not accurate
  • (Usability) Hyperlinks in Test Log view are rendered differently for the Test Execution event type.
  • scroll bars not appearing when needed in test suite editor and other Hyades editors when content doesn't all fit in a page
  • (Testing Tool) Invalid characters inserted in source folder textbox when using Browse button of "Generate..." menu item
  • Report Icon is incorrect for Test Pass and Time Frame Historic
  • Simplified Chinese translation when editing a datapool is incorrect
  • Incorrect german translation of the word "Pass"
  • Copy / Paste should not be available in the logical test navigator
  • (Usability) Missing/inconsistent titles/descriptions/icons in test report dialogs.
  • (Usability) Test invocation error message cannot be copied
  • Malformed report window time stamps in the report wizard.
  • Confusing label in Test preferences.
  • Remove the "open editor" button on the Report Wizard first page
  • Add help icon to Report Wizard
  • Need new icon for testlog files
  • Formatting messages make translation difficult.
  • (Usability) Switch to Test Perspective after test execution.
  • (Usability) Switch to Test Perspective after creating a test asset.
  • Log Viewer : navigation button on event part of test log are not enabled by default
  • Remove XMLUnit dependency and convert reporting tests to TPTP tests.
  • TPTP test pass reports show test type ID instead of meaningful name.

• Duwayne:
  • Vista-specific error dialog when recording using IAC/IE on XP.
  • ASF marshalling return value between service and client adapter does not have support for failures / exceptions
  • Get rid of the Remove option from the Http Requests tab of the Hyades URL Test Suite
  • Text in Recorder Control should be copyable.
  • Repeated launch through Automated Services Framework eventually fails
  • (Test Automation) Automate manual test suites using the Automated GUI Recorder.
  • RecorderException when HTTP recording with Internet Explorer on Windows XP.

• Kendric:
  • (Linux) AGR test suite does not run.
  • (Test Automation) Automate manual test suites using the Automated GUI Recorder.

Miscellaneous

• (Scalability) Address TPTP EMF model scalability problems: Although withdrawn as a 4.5 candidate enhancement, the outcome/status of the work done in 4.4 on this enhancement was not updated in the WIKI page. Joe will update the WIKI.

• Test project topics for upcoming AG calls include:
  • Enhancement Move, Copy, Delete, Rename and Import/Export test assets: Jerome.
  • Test automation initiative: Alan/Joel
  • EMMA: Paul

Round-table

Paul

• Last Week:
  • Completed defects:
    • XMLSave* and tempResouce* files are not removed from the user's temporary directory..
    • Isolate and move BIRT Reports to as-is..
    • (Web Doc) Create web document for BIRT Test Reports..
    • (Web Doc) Create web document for BIRT Trace Reports..
    • (Web Doc) Create web document for BIRT Log Reports..
    • (Web Doc) Create web document for BIRT Statistical Reports..
    • IndexOutOfBoundsException thrown when running BVT junit test.
    • BVT JUnit test does not run.
    • Execution result of Monitor.Analysis.LogImport_Windows_IA32 is not showing up in the 4.5 i5 TP2 test report.
    • Debug message printed to console when launching tests on Linux..

• This Week:
  • Enhancement:
    • Generic Recorder Wizard enhancement to filter the list of recorders.
  • Defects:
    • Problems in displaying Hebrew (Bi-Directional) text in the TPTP Log Viewer.
    • Remove references to internal APIs..
    • OutOfMemoryError when generating large TPTP test reports..
    • Deploying junit plug-in test to remote Windows machine from a Linux machine fails.
    • Importing large datapool freezes wizard..
    • Exported datapool with deleted variables is incorrect..

Duwayne

• Last Week:
  • Working on enhancement Test execution should support parallel execution of tests including investigating sequence of events and setting up a test environment for multiple agents.

• This Week:
  • Enhancement:
    • Test execution should support parallel execution of tests.
  • Defect:
    • RecorderException when HTTP recording with Internet Explorer on Windows XP..

Jerome

• Last Week:
  • Working on enhancement Move, Copy, Delete, Rename and Import/Export test assets including chairing a call to discuss the final design decisions (see the meeting minutes).

• This Week:
  • Enhancement:
    • Move, Copy, Delete, Rename and Import/Export test assets.

Action items

Jerome

• Schedule a follow-on call/demo for the week of the January 28 - February 1, 2008 for enhancement Move, Copy, Delete, Rename and Import/Export test assets.

Notes

News

• Tony Wang has joined the Test Project as a co-op (IBM) for four months.

EclipseCon 2008

• Test and Performance Category.
• Test and Performance Presentations
• If you are interested in proposing a poster (presented at the poster reception session) or BoF (informal one-and-a-half-hour gatherings of people who want to talk about a particular topic), please:
  • Review the EclipseCon 2008 Submission Guidelines
  • Submit your poster or BoF
• Important dates include:
  • January 19, 2008: Submissions open for posters and BoFs.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.