Difference between revisions of "TPTP-Test-Tools-20080707"

Latest revision as of 08:58, 8 July 2008

Attendees

• Present:
  • Paul Slauenwhite
  • Tony Wang
  • Jerome Bozier
  • DuWayne Morris

4.5

Release Information

• 4.5 has shipped with the Ganymede Simultaneous Release on June 25, 2008.
  • Congratulations and thanks to all of the Test Project committers!

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Release Summary

• 226 new Bugzillas opened:
  • Test Project originated⁴: 142
  • TPTP (other sub-projects) originated: 33
  • Community originated: 51
  • Unresolved: 49
  • Fixed: 130
  • Invalid: 5
  • Won't fix¹: 7
  • Duplicate: 22
  • Works for me: 13

• 399 Bugzillas resolved:
  • Fixed: 199
  • Invalid: 10
  • Won't fix¹: 116
  • Duplicate: 38
  • Works for me: 35
  • Not Eclipse: 1

• 221 old Bugzillas resolved:
  • Fixed: 69
  • Invalid: 5
  • Won't fix¹: 109
  • Duplicate: 16
  • Works for me: 22

• Fixed defects by committer:
  • Paul (100%): 154 (614.5 PH)
  • Jerome (50%): 21 (469.75 PH)
  • Duwayne (90%): 17 (312.5 PH)
  • Tony² (100%): 4 (42.5 PH)
  • Other³: 3 (807.1 PH)

• 4 enhancements delivered.

• 48.5% increase in our test bucket:
  • 4.4.0: 400 tests
  • 4.5.0: 594 tests

• Ongoing work:
  • Executing the Test Project Tests for each test pass.
  • Parallel release TPTP 4.4.1.
  • News group and mailing list posts.
  • Triage new defects.

¹: Existing and new defects opened against the As-Is Components are returned as WONTFIX.

²: Co-op new on TPTP as of January 1, 2008.

³: 803 PH contributed by non-committer resources for enhancement 202695.

⁴: As a result of increased internal project testing.

4.5.1

Release Information

• 4.5.1 will ship with the Ganymede Service Release 1 or SR1 (target release date: September 24, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• We have completed 1.5 weeks of development.

• We have 5.5 weeks of development remaining (target: August 12).

Defects

• Queries.

• Platform Project defects impacting the Test Project:
  • Major:
    • Execution of any testsuite fails using the IAC - InactiveProcessException: Targeted to I8.

• Bugzillas (in order of completion):
  • Jerome:
    • Test Navigator deadlocks in UI thread
    • CoreExpcetion thrown when renaming a test that has just been pasted: Required by a consuming product. Requires a patch for 4.5.0.
    • Test asset depenencies not updated on save: Required by a consuming product. Requires a patch for 4.5.0.
    • Refresh proxies for a re/opened project.: Required by a consuming product.
    • Unable to delete some projects in Test Perspective
    • 'Save as' option doesn't support test execution result
    • Duplicate execution time in .execution file in Test Perspective
    • Changing the file name of a test asset in the Test Navigator updates the logical name.
    • Rename error in Java perspective with test assets created in Test perspective
  • Paul:
    • Test Navigator does not support the Delete/Del key.: Required by a consuming product.
    • Automated Test Execution Harness Tests
    • AGR test suites model disabled test invocations incorrectly.
    • IExecutionDeploymentAdapter.cleanUpTestAssets no longer called
    • Test Navigator action OpenReportAction is hardcoded, not defined in an extension
    • Test log viewer does not display extended properties.
    • Test Execution Tabular Report contains empty or incorrect child reports.
    • Provide ISV documentation for enhancement 166025.
    • When i try to open a TPTP Junit test result it gives me an error "Could not open the editor: An unexpected exception was thrown."
    • HTTP tests do not automatically generate JUnit Java code like JUnit tests.
    • Test Log Viewer does not show test suite/invocation hyperlinks after a test execution event is displayed.
    • WidgetFactory automatically scrolls to the right.
    • Cannot scroll to the bottom of the log file in log viewer events page
    • Can not debug launched eclipse process via ASF without rebuilding TPTP jar
    • Unable to associate multiple TestCases with an artifact
    • Test execution node in the events tree is missing a Defects pane
    • Create TPTP JUnit test suites for test model test classes.
    • Providing the ability to record user's interactions with GEF objects in a GEF editor
  • Tony:
    • Accessibility-Need shortcuts for all Test Navigator pulldowns: Required by a consuming product.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.
    • Test Log Viewer AGR test suites do not run.

4.5.2

Release Information

• 4.5.2 will ship with the Ganymede Service Release 2 or SR2 (target release date: February 25, 2009).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defects include:
    • Paul:
      • JUnit and JUnit Plug-in test execution add incorrect elements to the plugin.xml file.
      • AGR Tests require absolute path to Equinox JAR
      • Clear remote workspace launch does not work for remote test execution
      • AGR Tests cannot be run with start ACServer
      • Test Execution Tabular Report contains empty or incorrect child reports.
      • IExecutionDeploymentAdapter.cleanUpTestAssets no longer called
      • AbstractTestExecutionService – “Process was null -- test completed too fast?” message
      • Connection property does not deploy all dependencies
      • Test Execution fails when project defined incorrectly - ResourceException
      • Connection property does not allow JUnit Plug-in Tests to be executed
      • ASF marshalling return value between service and client adapter does not have support for failures / exceptions
      • Confusing exceptions when running automated services.
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • Exceptions when running ASF tasks.
      • Only the name of the execution result is used from the results property.

Miscellaneous

• As of June 25 (TPTP 4.5.0 Ganymede), Duwayne has moved off of TPTP and the Test Project.
  • Thanks to Duwayne for contribution to the project since 2003.
  • Duwayne's defects/enhancements have been reassigned to Paul.
  • Duwayne will nominate Paul on the Test Project mailing list as the Component Lead for the following components:
    • Test.Agents.Recorder
    • Test.Execution.AutoGUIRunner
    • Test.Execution.URLRunner
    • Test.UI.AutoGUIUI
    • Test.UI.URLTest
    • ASF.Runtime
    • Documentation (ASF)
  • Paul will update the TPTP Project Matrix with the changes once voting is complete.

• As of June 25 (TPTP 4.5.0 Ganymede), Paul is working 50% on TPTP and the Test Project.
  • Eugene Chan has assumed the position as TPTP AG Lead.
  • Paul will focussed on his defect load in 4.5.1/4.5.2, with Joanna assuming the planning/project management responsibilities for the Test Project.
    • Paul will continue to provide technical/planning/project management leadership for the Test Project.
    • We will continue the weekly Test Project calls until the transition is complete.

Round-table

Paul

• Last Week:
  • Out of office: 2 days
  • Resolved defects:
    • Variable type in DataPool can be typed manually by user
    • Revise release note for IPv6 HTTP Recording
    • Text associated with deleting datapool's popup window needs to be improved.
    • TPTP EMF models needs to update
    • Generic Recorder wizard should preset wizard selection based on previous page selections

• This Week:
  • Defects.

Duwayne

• Last Week:
  • Tested IPv6.
  • Out of office: 3 days

• This Week:
  • Action items.

Jerome

• Last Week:
  • Resolved defects:
    • The File is missing in Test Navigator after rename it with an exteremely long name

• This Week:
  • Action items.
  • Defects.

Tony

• Last Week:
  • Out of office: 2 days
  • Test automation.

• This Week:
  • Action items.
  • Defects.

Action items

• Duwayne:
  • Verify/close your resolved defects.
  • Reply to the question in jdt.ui bundle activator assumes PlatformUI.getWorkbench(), causing autobuild failure when running headless.
  • Nominate Paul on the TPTP mailing list as the Component Lead for the following components:
    • Test.Agents.Recorder
    • Test.Execution.AutoGUIRunner
    • Test.Execution.URLRunner
    • Test.UI.AutoGUIUI
    • Test.UI.URLTest
    • ASF.Runtime
    • Documentation (ASF)
  • Post the meeting minutes for the June 16, 23, 30 meetings.

• Jerome:
  • Verify/close your resolved defects.

• Tony:
  • Verify/close your resolved defects.

Notes

• Thanks to Duwayne for covering the Test Project calls for the last three Mondays (June 16, 23, 30) during Paul's absence.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.