Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
TPTP-Test-Tools-20080707
Contents
Attendees
- Present:
- Paul Slauenwhite
- Tony Wang
- Jerome Bozier
- DuWayne Morris
4.5
Release Information
- 4.5 has shipped with the Ganymede Simultaneous Release on June 25, 2008.
- Congratulations and thanks to all of the Test Project committers!
Release Summary
- 226 new Bugzillas opened:
- Test Project originated4: 142
- TPTP (other sub-projects) originated: 33
- Community originated: 51
- Unresolved: 49
- Fixed: 130
- Invalid: 5
- Won't fix1: 7
- Duplicate: 22
- Works for me: 13
- 399 Bugzillas resolved:
- Fixed: 199
- Invalid: 10
- Won't fix1: 116
- Duplicate: 38
- Works for me: 35
- Not Eclipse: 1
- 221 old Bugzillas resolved:
- Fixed: 69
- Invalid: 5
- Won't fix1: 109
- Duplicate: 16
- Works for me: 22
- Fixed defects by committer:
- Paul (100%): 154 (614.5 PH)
- Jerome (50%): 21 (469.75 PH)
- Duwayne (90%): 17 (312.5 PH)
- Tony2 (100%): 4 (42.5 PH)
- Other3: 3 (807.1 PH)
- 4 enhancements delivered.
- 48.5% increase in our test bucket:
- 4.4.0: 400 tests
- 4.5.0: 594 tests
- Ongoing work:
- Executing the Test Project Tests for each test pass.
- Parallel release TPTP 4.4.1.
- News group and mailing list posts.
- Triage new defects.
1: Existing and new defects opened against the As-Is Components are returned as WONTFIX.
2: Co-op new on TPTP as of January 1, 2008.
3: 803 PH contributed by non-committer resources for enhancement 202695.
4: As a result of increased internal project testing.
4.5.1
Release Information
- 4.5.1 will ship with the Ganymede Service Release 1 or SR1 (target release date: September 24, 2008).
Where are we at?
- We have completed 1.5 weeks of development.
- We have 5.5 weeks of development remaining (target: August 12).
Defects
- Platform Project defects impacting the Test Project:
- Major:
- Bugzillas (in order of completion):
- Jerome:
- Test Navigator deadlocks in UI thread
- CoreExpcetion thrown when renaming a test that has just been pasted: Required by a consuming product. Requires a patch for 4.5.0.
- Test asset depenencies not updated on save: Required by a consuming product. Requires a patch for 4.5.0.
- Refresh proxies for a re/opened project.: Required by a consuming product.
- Unable to delete some projects in Test Perspective
- 'Save as' option doesn't support test execution result
- Duplicate execution time in .execution file in Test Perspective
- Changing the file name of a test asset in the Test Navigator updates the logical name.
- Rename error in Java perspective with test assets created in Test perspective
- Paul:
- Test Navigator does not support the Delete/Del key.: Required by a consuming product.
- Automated Test Execution Harness Tests
- AGR test suites model disabled test invocations incorrectly.
- IExecutionDeploymentAdapter.cleanUpTestAssets no longer called
- Test Navigator action OpenReportAction is hardcoded, not defined in an extension
- Test log viewer does not display extended properties.
- Test Execution Tabular Report contains empty or incorrect child reports.
- Provide ISV documentation for enhancement 166025.
- When i try to open a TPTP Junit test result it gives me an error "Could not open the editor: An unexpected exception was thrown."
- HTTP tests do not automatically generate JUnit Java code like JUnit tests.
- Test Log Viewer does not show test suite/invocation hyperlinks after a test execution event is displayed.
- WidgetFactory automatically scrolls to the right.
- Cannot scroll to the bottom of the log file in log viewer events page
- Can not debug launched eclipse process via ASF without rebuilding TPTP jar
- Unable to associate multiple TestCases with an artifact
- Test execution node in the events tree is missing a Defects pane
- Create TPTP JUnit test suites for test model test classes.
- Providing the ability to record user's interactions with GEF objects in a GEF editor
- Tony:
- Accessibility-Need shortcuts for all Test Navigator pulldowns: Required by a consuming product.
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.
- Test Log Viewer AGR test suites do not run.
- Jerome:
4.5.2
Release Information
- 4.5.2 will ship with the Ganymede Service Release 2 or SR2 (target release date: February 25, 2009).
Test Automation Initiative
- Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
- For more information, see the WIKI page.
- To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
- Outstanding defects include:
- Paul:
- JUnit and JUnit Plug-in test execution add incorrect elements to the plugin.xml file.
- AGR Tests require absolute path to Equinox JAR
- Clear remote workspace launch does not work for remote test execution
- AGR Tests cannot be run with start ACServer
- Test Execution Tabular Report contains empty or incorrect child reports.
- IExecutionDeploymentAdapter.cleanUpTestAssets no longer called
- AbstractTestExecutionService – “Process was null -- test completed too fast?” message
- Connection property does not deploy all dependencies
- Test Execution fails when project defined incorrectly - ResourceException
- Connection property does not allow JUnit Plug-in Tests to be executed
- ASF marshalling return value between service and client adapter does not have support for failures / exceptions
- Confusing exceptions when running automated services.
- ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
- ANT test results property requires trailing slash to specify location
- Exceptions when running ASF tasks.
- Only the name of the execution result is used from the results property.
- Paul:
Miscellaneous
- As of June 25 (TPTP 4.5.0 Ganymede), Duwayne has moved off of TPTP and the Test Project.
- Thanks to Duwayne for contribution to the project since 2003.
- Duwayne's defects/enhancements have been reassigned to Paul.
- Duwayne will nominate Paul on the Test Project mailing list as the Component Lead for the following components:
- Test.Agents.Recorder
- Test.Execution.AutoGUIRunner
- Test.Execution.URLRunner
- Test.UI.AutoGUIUI
- Test.UI.URLTest
- ASF.Runtime
- Documentation (ASF)
- Paul will update the TPTP Project Matrix with the changes once voting is complete.
- As of June 25 (TPTP 4.5.0 Ganymede), Paul is working 50% on TPTP and the Test Project.
- Eugene Chan has assumed the position as TPTP AG Lead.
- Paul will focussed on his defect load in 4.5.1/4.5.2, with Joanna assuming the planning/project management responsibilities for the Test Project.
- Paul will continue to provide technical/planning/project management leadership for the Test Project.
- We will continue the weekly Test Project calls until the transition is complete.
Round-table
Paul
- Last Week:
- Out of office: 2 days
- Resolved defects:
- This Week:
- Defects.
Duwayne
- Last Week:
- Tested IPv6.
- Out of office: 3 days
- This Week:
- Action items.
Jerome
- Last Week:
- This Week:
- Action items.
- Defects.
Tony
- Last Week:
- Out of office: 2 days
- Test automation.
- This Week:
- Action items.
- Defects.
Action items
- Duwayne:
- Verify/close your resolved defects.
- Reply to the question in jdt.ui bundle activator assumes PlatformUI.getWorkbench(), causing autobuild failure when running headless.
- Nominate Paul on the TPTP mailing list as the Component Lead for the following components:
- Test.Agents.Recorder
- Test.Execution.AutoGUIRunner
- Test.Execution.URLRunner
- Test.UI.AutoGUIUI
- Test.UI.URLTest
- ASF.Runtime
- Documentation (ASF)
- Post the meeting minutes for the June 16, 23, 30 meetings.
- Jerome:
- Verify/close your resolved defects.
- Tony:
- Verify/close your resolved defects.
Notes
- Thanks to Duwayne for covering the Test Project calls for the last three Mondays (June 16, 23, 30) during Paul's absence.
Reminders
Lead Committers
- Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
- Add the Original Estimate (PH) when triaging a new defect.
- Update the Hours Worked (PH) when completing a defect.
- Test their components or review/track testing contributed by other committers/resources.
- Monitor the TPTP news group and answer posts specific to their Test Project components.
- Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
- Use the MyFoundation Portal for committer elections.