TPTP-Test-Tools-20080310

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Tony Wang

• Absent:
  • Jerome Bozier

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• We are in the fourth week of I6 development.
  • The PMC has extended the development cycle of I6 (total: 5 weeks) (target: March 21) and I7 (total: 1 weeks) (target: April 18) each by one week.
  • As a result, the I6 and I7 TP1 will each be 1 week.

Newsgroup

• Newsgroup posts requiring a reply:
  • Duwayne:
    • support for RCP product in TPTP4.5i4
    • Using wait command in AGR script
    • AGR test cases in standard mode

Testing

• Translation Verification Tests (TVT) and enablement tests are due Wednesday, March 19.
  • Writing translation verification test cases
  • Writing enablement test cases
  • Check in enablement and translation verification test cases

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defect against the Test Project include:
    • Paul:
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests
      • Content missing in Tabular Report
      • Connection property does not deploy all dependencies
      • Connection property does not allow JUnit Plug-in Tests to be executed
    • Duwayne:
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • ANT importExistingProjects throws Exception

Enhancements

• Queries.
• Schedule.

• Xin Ying Huang:
  • Encrypted datapool variable support: Paul and Xin and dialogging on refactoring the patch. Xin is also writing the test cases and documentation for the enhancement.

• Duwayne:
  • Test execution should support parallel execution of tests: Duwayne completed and checked-in the implementation, which Paul will review this week. He is working on the test cases, to be completed this week. Duwayne will update hours worked.

• Jerome:
  • Move, Copy, Delete, Rename and Import/Export test assets: Paul reviewed the refined patch file. Jerome will continue on refining the implementation.

• Paul:
  • Generic Recorder Wizard enhancement to filter the list of recorders: The implementation is complete except for dependent defects Generic recorder wizard forbids customization of the Location page and (Product) Allow programmatic context for initially selected project in Generic Recorder Wizard. This enhancement required a substantial amount of refactoring to remove dead/duplicate code, simplify the URL Recorder preferences, and improve the readability of UI strings. Paul is finishing testing before closing the enhancement.

• Alexander Nyßen:
  • Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. Paul has reviewed the patch and is proceeding with AG/PMC approval before opening a Contribution Questionnaire (CQ) for the contribution. This enhancement may not be contained in 4.5.

Defects

• Queries.

• Schedule.

• Bugzilla Prefix Legend:
  • [Product]: Defects required by consuming products.
  • [APAR]: Defects required by consuming products for customer support.

• [APAR]:
  • (APAR) Test Infrastructure doesn't work in firewalled environment: Transfered to the Platform Project for completion in I6.
  • (APAR) Repeated launch through Automated Services Framework eventually fails: Transfered to the Platform Project for completion in I6.
  • (APAR) UI allows to launch non-profilable tests in profile mode.

• [Product]:
  • (Product) Consumming Product: ASF Throws Modal Dialog Box.
  • (Product) Cannot remove a test invocation to a removed HTTP request.
  • (Product) HTTP recording does not work with Internet Explorer 7 and Firefox 2.0
  • (Product) Allow programmatic context for initially selected project in Generic Recorder Wizard
  • (Product) intermittently see start and stop recording problems
  • (Product) HTTP Recorder does not function if TMP dir does not exist
  • (Product) Recorder launch wizard does not allow spaces
  • (Product) (Usability) HTTP tests do not automatically generate JUnit Java code like JUnit tests.
  • (Product) copy/paste of a simple folder does not work in Test Navigator view
  • (Product) Usability - adding existing artifacts/locations to deployment should select by name (not filename)
  • (Product) Test assets' editors (locations, datapools etc) allow save with empty internal names
  • (Product) doc updates for section Creating a test deployment
  • (Product) what does the synchronous option mean for an invocation behavior in a JUnit Test Suite?
  • (Product) Time Frame Historical Report view does not have tabs and is missing info
  • (Product) Test Log Viewer: Link to deployment is displayed when using temp deploy not named 'default'
  • (Product) (Usability) creating TPTP test but you need to have parent project created first.
  • (Product) Generate Report: Test Navigator does not refresh to show new report
  • (Product) variables are listed twice in the "EquivalenceClass" pane of Datapool
  • (Product) Context sensitive help requires refactoring and new content.
  • (Product) scroll bars not appearing when needed in test suite editor and other Hyades editors when content doesn't all fit in a page
  • (Product) Accessibility-Need shortcuts for all Test Navigator pulldowns
  • (Product) Unmovable rows in Datapool Editor
  • (Product) Report Icon is incorrect for Test Pass and Time Frame Historic

I6 Defect Schedule

• February 25 - February 29:
  • Duwayne:
    • (APAR) Repeated launch through Automated Services Framework eventually fails: Moved to the Platform Project
    • Test execution should support parallel execution of tests: SLIPPED 2
  • Jerome:
    • Move, Copy, Delete, Rename and Import/Export test assets.: SLIPPED 2
  • Paul K.:
    • (Product) Accessibility-Need shortcuts for all Test Navigator pulldowns: SLIPPED 2
  • Tony:
    • API Recorder's Generate Test Suite dialog does not select a default selection.: COMPLETE
    • (Usability) Switch to Test Perspective after creating a test asset.: COMPLETE
  • Paul:
    • Generic Recorder Wizard enhancement to filter the list of recorders: SLIPPED 2
    • Vista-specific error dialog when recording using IAC/IE on XP.: COMPLETE
    • Importing large datapool freezes wizard.: COMPLETE
    • Remove references to internal APIs.: COMPLETE
    • Exported datapool with deleted variables is incorrect.: COMPLETE
    • Cannot import HTTP recording file.: COMPLETE
    • Running ASF through Ant requires display export: COMPLETE
    • Duplicate wizards for creating a URL recording/test.: COMPLETE
    • Reinstate features and 'empty' plug-ins for as-is components.: COMPLETE
• March 3 - March 7:
  • Duwayne:
    • (Product) HTTP Recorder does not function if TMP dir does not exist: SLIPPED
  • Jerome:
    • (Product) Copying lots of test results to a newly created folder hangs the system: COMPLETE
    • (Product) copy/paste of a simple folder does not work in Test Navigator view: SLIPPED
    • Adding a location or artifact with a duplicate name of a removed resource in a deployment does not work: SLIPPED
    • Filename vs. logical name in UI: SLIPPED
  • Paul K.:
    • (Product) scroll bars not appearing when needed in test suite editor and other Hyades editors when content doesn't all fit in a page: SLIPPED
    • Log Viewer : navigation button on event part of test log are not enabled by default: SLIPPED
  • Tony:
    • (Usability) Missing/inconsistent titles/descriptions/icons in test report dialogs.: SLIPPED
  • Paul:
    • (Product) Allow programmatic context for initially selected project in Generic Recorder Wizard: SLIPPED
    • (Usability) Switch to Test Perspective after test execution.: SLIPPED
    • (Usability) Test Log view does not open after a test execution has completed.: SLIPPED
    • Recording wizard - description text is truncated: COMPLETE
    • Document, publicize and remove deprecated classes/APIs.: SLIPPED
    • (Product) Test Log Viewer: Link to deployment is displayed when using temp deploy not named 'default': SLIPPED
    • Test Tools documentation I5 smoke test failures.: SLIPPED
    • (Product) (Usability) creating TPTP test but you need to have parent project created first.: SLIPPED
    • (Usability) Provide option to open Test Perspective after creating test assets.: COMPLETE
    • (APAR) UI allows to launch non-profilable tests in profile mode: SLIPPED
    • Generic recorder wizard forbids customization of the Location page: SLIPPED
    • Location does not contain port number.: SLIPPED
    • (Vista) Windows informational dialog when generating JScrib test reports.: SLIPPED
• March 10 - March 14:
  • Duwayne:
    • (Product) intermittently see start and stop recording problems
    • (Product) Cannot remove a test invocation to a removed HTTP request.
    • URL Recorder operational messages require cleanup.
    • NullPointerException when requesting publication of AGR test results from Ant script
  • Jerome:
    • (Not working on TPTP)
  • Paul K.:
    • (Product) Unmovable rows in Datapool Editor
  • Tony:
    • (Product) Report Icon is incorrect for Test Pass and Time Frame Historic
    • non-externalized strings in org.eclipse.hyades.execution
    • Deprecate JScrib and JScrib report generators.
    • Test.Execution.JUnitRunner.testsuite and Test.Execution.JUnitRunner.Bug186196.testsuite are failing.
  • Paul:
    • Encrypted datapool variable support
    • Providing the ability to record user's interactions with GEF objects in a GEF editor
    • Update copyright dates and translatability errors.
    • (Product) variables are listed twice in the "EquivalenceClass" pane of Datapool
    • (Usability) Verdict Summary BIRT chart in Test Log viewer displays 0%.
    • JUnit/Plug-in tests do not allow plugin root as source folder.
    • (Usability) .execution files should give more informative statistics
    • Remove XMLUnit dependency and convert reporting tests to TPTP tests.
    • (Usability) Hyperlinks in Test Log view are rendered differently for the Test Execution event type.
    • Move JUnit Plug-in test tools documentation to a separate plug-in.: COMPLETE
    • Need new icon for testlog files
    • Datapools are not portable.
    • Clean-up the TPTP committer lists and project matrix.
    • Removing an Artifact Location Pair returns a Null Pointer Exception
    • Adding a location or artifact with a duplicate name of a removed resource in a deployment does not work
    • Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.

Miscellaneous

• Test project topics for upcoming AG calls include:
  • ASF and Test Services: Joe
  • Test automation initiative: Alan/Joel/Paul

Round-table

Paul

• Last Week:
  • Code/UI reviewed:
    • Move, Copy, Delete, Rename and Import/Export test assets
    • Encrypted datapool variable support
  • Resolved defects:
    • Recording wizard - description text is truncated
    • Importing large datapool freezes wizard.
    • Remove references to internal APIs.
    • Exported datapool is incorrect.
    • Cannot import HTTP recording file.
    • Duplicate wizards for creating a URL recording/test.

• This Week:
  • Defects.
  • Enhancements:
    • Generic Recorder Wizard enhancement to filter the list of recorders.
  • Finish reviewing:
    • Move, Copy, Delete, Rename and Import/Export test assets
    • Encrypted datapool variable support
    • Test execution should support parallel execution of tests
  • EclipseCon 2008 preparation.
  • Enablement and TVT test cases.

Duwayne

• Last Week:
  • Refactoring the patch for Test execution should support parallel execution of tests.
  • Assisted a consuming product with diagnosing a firewall issue when launching tests.
  • Assisted a consuming product with [https://bugs.eclipse.org/bugs/show_bug.cgi?id=142032 (Product) Public API Needed for Determining if IAC versus AC is running).
  • Worked on defect (Product) HTTP Recorder does not function if TMP dir does not exist
  • Non-TPTP work (1 PD).

• This Week:
  • Defects.
  • Enhancements:
  • Test execution should support parallel execution of tests.

Jerome

• Last Week:
  • [absent]

• This Week:
  • Defects.
  • Enhancements:
    • Move, Copy, Delete, Rename and Import/Export test assets.

Tony

• Last Week:
  • Completed implementation on defect:
    • (Usability) Missing/inconsistent titles/descriptions/icons in test report dialogs.
  • Worked on defects:
    • (Usability) Switch to Test Perspective after test execution.
    • (Usability) Test Log view does not open after a test execution has completed.

• This Week:
  • Defects.

Action items

• Enhancement owners to write and check in Translation Verification Tests (TVT) and enablement tests.

Notes

• The weekly Test Project call will be canceled in two weeks (March 24) since Paul is on vacation.

EclipseCon 2008

• Test and Performance Category.
• Test and Performance Presentations

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.