Difference between revisions of "TPTP-Test-Tools-20080707"

Revision as of 08:41, 7 July 2008

Attendees

• Present:
  • Paul Slauenwhite
  • Tony Wang
  • Jerome Bozier
  • DuWayne Morris

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 25, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• RC3 was delivered on Tuesday, June 3.

• We have completed the I8 TP2.

• RC4 (final RC) was originally scheduled for Friday, June 6.
  • It has been delayed until the official RC4 date for +3 projects (Wednesday, June 11).
  • On last week's AG call, we discussed the possibility of a point release (e.g. 4.5.0.1) to resolve defects that cannot be contained in 4.5.0 but are required by the community or a consuming product.
    • We are attempting to eliminate the need for a point release (e.g. 4.5.0.1) by delaying RC4 (final RC) to resolve the remaining defects required by the community or a consuming product.

• Agenda for this week:
  • Resolve the remaining I8 defects.
  • Smoke test the RC4 candidate driver.
  • Verify/close our resolved defects.

Defect Verification

• A note has been sent to the originators of all resolved defects reminding them to verify/close these defects before Ganymede releases.

• Please verify/close your resolved defects this week:
  • Paul.
  • Duwayne.
  • Jerome: Tony will assist.

News Group

• The following news group posts require a reply:
  • Duwayne:
    • Re: HTTP Recording stops immediately after start-up (FireFox) or never records data (IE) (March 25, 2008 1:15 PM)
    • Re: NoClassDefFoundError: org.eclipse.hyades.test.common...? (April 10, 2008 5:33 PM)
    • How to record Properties View values (Property <-> Value pair) ??? (June 9, 2008 8:12 AM)

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defects include:
    • Paul:
      • JUnit and JUnit Plug-in test execution add incorrect elements to the plugin.xml file.
      • AGR Tests require absolute path to Equinox JAR
      • Clear remote workspace launch does not work for remote test execution
      • AGR Tests cannot be run with start ACServer
      • Test Execution Tabular Report contains empty or incorrect child reports.
      • IExecutionDeploymentAdapter.cleanUpTestAssets no longer called
    • Duwayne:
      • AbstractTestExecutionService – “Process was null -- test completed too fast?” message
      • Connection property does not deploy all dependencies
      • Test Execution fails when project defined incorrectly - ResourceException
      • Connection property does not allow JUnit Plug-in Tests to be executed
      • ASF marshalling return value between service and client adapter does not have support for failures / exceptions
      • Confusing exceptions when running automated services.
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • Exceptions when running ASF tasks.
      • Only the name of the execution result is used from the results property.

Enhancements

• Queries.
• Schedule.

• Alexander Nyßen:
  • Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. AG/PMC approved and Contribution Questionnaire (CQ) approved. Since we will be running AGR test suites to smoke test the RC5 candidate, Paul will complete the integration, testing, and check-in after RC5 has dropped (target: June 17). This enhancement requires updates to the AGR user guide for the outstanding function (see Support capturing additional draw2d related events when recording user's interactions with a GEF editor).

Defects

• Queries.

• Schedule.

• Defects require a reply:
  • Duwayne:
    • jdt.ui bundle activator assumes PlatformUI.getWorkbench(), causing autobuild failure when running headless

• Platform Project defects impacting the Test Project:
  • Critical/Blocker:
    • Random intermitten errors while launching a test against remote agents: Targeted to I8.
    • command line and runtime workbench unsatisfied link error: Targeted to I8.
  • Major/Normal:
    • Execution of any testsuite fails using the IAC - InactiveProcessException: Targeted to I8.

• Remaining I8 Bugzillas:
  • Paul:
    • Clean-up the TPTP committer lists and project matrix.: Platform Project defect.
    • Providing the ability to record user's interactions with GEF objects in a GEF editor: Paul will complete the integration, testing, and check-in this week now that I8 TP2 AGR tests have been completed.
    • Automated Test Execution Harness Tests: Test automation defect.
    • All external APIs should have JUnit tests: Test automation defect.
  • Duwayne:
    • Execution of any testsuite fails using the IAC - InactiveProcessException: Platform Project defect.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation defect.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation defect.
  • Tony:
    • (Linux) AGR test suite does not run.: Test automation defect.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation defect

Release Summary

4.5.1

Release Information

• 4.5.1 will ship with the Ganymede Service Release 1 or SR1 (target release date: September 24, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• We have completed 1.5 weeks of development.

• We have 5.5 weeks of development remaining (target: August 12).

Defects

• Queries.

• Platform Project defects impacting the Test Project:
  • Major:
    • Execution of any testsuite fails using the IAC - InactiveProcessException: Targeted to I8.

• Bugzillas:
  • Paul:
    • Clean-up the TPTP committer lists and project matrix.: Platform Project defect.
    • Providing the ability to record user's interactions with GEF objects in a GEF editor: Paul will complete the integration, testing, and check-in this week now that I8 TP2 AGR tests have been completed.
    • Automated Test Execution Harness Tests: Test automation defect.
    • All external APIs should have JUnit tests: Test automation defect.
  • Duwayne:
    • Execution of any testsuite fails using the IAC - InactiveProcessException: Platform Project defect.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation defect.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation defect.
  • Tony:
    • (Linux) AGR test suite does not run.: Test automation defect.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation defect

4.5.2

Release Information

• 4.5.2 will ship with the Ganymede Service Release 2 or SR2 (target release date: February 25, 2009).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defects include:
    • Paul:
      • JUnit and JUnit Plug-in test execution add incorrect elements to the plugin.xml file.
      • AGR Tests require absolute path to Equinox JAR
      • Clear remote workspace launch does not work for remote test execution
      • AGR Tests cannot be run with start ACServer
      • Test Execution Tabular Report contains empty or incorrect child reports.
      • IExecutionDeploymentAdapter.cleanUpTestAssets no longer called
      • AbstractTestExecutionService – “Process was null -- test completed too fast?” message
      • Connection property does not deploy all dependencies
      • Test Execution fails when project defined incorrectly - ResourceException
      • Connection property does not allow JUnit Plug-in Tests to be executed
      • ASF marshalling return value between service and client adapter does not have support for failures / exceptions
      • Confusing exceptions when running automated services.
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • Exceptions when running ASF tasks.
      • Only the name of the execution result is used from the results property.

Miscellaneous

• As of June 25 (TPTP 4.5.0 Ganymede), Duwayne has moved off of TPTP and the Test Project.
  • Thanks to Duwayne for contribution to the project since 2004.
  • Duwayne's defects/enhancements have been reassigned to Paul.
  • Duwayne will nominate Paul on the TPTP mailing list as the Component Lead for the following components:
    • Test.Agents.Recorder
    • Test.Execution.AutoGUIRunner
    • Test.Execution.URLRunner
    • Test.UI.AutoGUIUI
    • Test.UI.URLTest
    • ASF.Runtime
    • Documentation (ASF)

Round-table

Paul

• Last Week:
  • Resolved defects:
    • Unable to publish BIRT reports through ASF

• This Week:
  • Defects.

Duwayne

• Last Week:

• This Week:
  • Action items.

Jerome

• Last Week:
  • Resolved defects:
    • Loading error messages and deadlocking in TestNav

• This Week:
  • Action items.
  • Defects.

Tony

• Last Week:

• This Week:
  • Action items.
  • Defects.

Action items

• Duwayne:
  • Verify/close your resolved defects.
  • Reply to the question in jdt.ui bundle activator assumes PlatformUI.getWorkbench(), causing autobuild failure when running headless.
  • Nominate Paul on the TPTP mailing list as the Component Lead for the following components:
    • Test.Agents.Recorder
    • Test.Execution.AutoGUIRunner
    • Test.Execution.URLRunner
    • Test.UI.AutoGUIUI
    • Test.UI.URLTest
    • ASF.Runtime
    • Documentation (ASF)

• Jerome:
  • Verify/close your resolved defects.

• Tony:
  • Verify/close your resolved defects.

Notes

• Thanks to Paul will be out of the office for next three Mondays (June 16, 23, 30).
  • Duwayne will host the Test Project calls.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.