Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "TPTP-Test-Tools-20080707"
(→Defects) |
|||
(11 intermediate revisions by the same user not shown) | |||
Line 11: | Line 11: | ||
=== Release Information === | === Release Information === | ||
− | * 4.5 | + | * 4.5 has shipped with the Ganymede Simultaneous Release on June 25, 2008. |
+ | ** Congratulations and thanks to all of the Test Project committers! | ||
* [http://www.eclipse.org/tptp/home/project_info/releaseinfo/4.5/schedule.html Detailed Schedule.] | * [http://www.eclipse.org/tptp/home/project_info/releaseinfo/4.5/schedule.html Detailed Schedule.] | ||
Line 21: | Line 22: | ||
* [http://www.eclipse.org/tptp/reports/test/testpass_45.php?source=All Test reports.] | * [http://www.eclipse.org/tptp/reports/test/testpass_45.php?source=All Test reports.] | ||
− | === | + | === Release Summary === |
− | * | + | * 226 new Bugzillas opened: |
+ | ** Test Project originated<sup>4</sup>: 142 | ||
+ | ** TPTP (other sub-projects) originated: 33 | ||
+ | ** Community originated: 51 | ||
+ | ** Unresolved: 49 | ||
+ | ** Fixed: 130 | ||
+ | ** Invalid: 5 | ||
+ | ** Won't fix<sup>1</sup>: 7 | ||
+ | ** Duplicate: 22 | ||
+ | ** Works for me: 13 | ||
− | * | + | * 399 Bugzillas resolved: |
+ | ** Fixed: 199 | ||
+ | ** Invalid: 10 | ||
+ | ** Won't fix<sup>1</sup>: 116 | ||
+ | ** Duplicate: 38 | ||
+ | ** Works for me: 35 | ||
+ | ** Not Eclipse: 1 | ||
− | * | + | * 221 old Bugzillas resolved: |
− | ** | + | ** Fixed: 69 |
− | ** | + | ** Invalid: 5 |
− | *** | + | ** Won't fix<sup>1</sup>: 109 |
+ | ** Duplicate: 16 | ||
+ | ** Works for me: 22 | ||
− | * | + | * Fixed defects by committer: |
− | ** | + | ** Paul (100%): 154 (614.5 PH) |
− | ** | + | ** Jerome (50%): 21 (469.75 PH) |
− | ** | + | ** Duwayne (90%): 17 (312.5 PH) |
+ | ** Tony<sup>2</sup> (100%): 4 (42.5 PH) | ||
+ | ** Other<sup>3</sup>: 3 (807.1 PH) | ||
− | + | * 4 [http://www.eclipse.org/tptp/home/project_info/devplans/Eclipse%20TPTP%20Project%204.5%20Release%20Plan.htm#Features enhancements] delivered. | |
− | * | + | * 48.5% increase in our test bucket: |
+ | ** 4.4.0: 400 tests | ||
+ | ** 4.5.0: 594 tests | ||
− | * | + | * Ongoing work: |
− | ** [ | + | ** Executing the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Tests Test Project Tests] for each test pass. |
− | ** [ | + | ** Parallel release [http://www.eclipse.org/tptp/home/downloads/?ver=4.4.1 TPTP 4.4.1]. |
− | ** | + | ** News group and mailing list posts. |
+ | ** Triage new defects. | ||
− | = | + | <sup>1</sup>: Existing and new defects opened against the [http://www.eclipse.org/tptp/home/downloads/?ver=4.5.0#AsIsComponents As-Is Components] are returned as WONTFIX. |
− | + | <sup>2</sup>: Co-op new on TPTP as of January 1, 2008. | |
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | = | + | <sup>3</sup>: 803 PH contributed by non-committer resources for [https://bugs.eclipse.org/bugs/show_bug.cgi?id=202695 enhancement 202695]. |
− | + | <sup>4</sup>: As a result of increased internal project testing. | |
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
== 4.5.1 == | == 4.5.1 == | ||
Line 148: | Line 105: | ||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222382 Execution of any testsuite fails using the IAC - InactiveProcessException]: Targeted to I8. | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222382 Execution of any testsuite fails using the IAC - InactiveProcessException]: Targeted to I8. | ||
− | * Bugzillas: | + | * Bugzillas (in order of completion): |
− | ** | + | ** Jerome: |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=237841 Test Navigator deadlocks in UI thread] |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=239233 CoreExpcetion thrown when renaming a test that has just been pasted]: Required by a consuming product. Requires a patch for 4.5.0. |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=87285 Automated Test Execution Harness Tests]: | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=236426 Test asset depenencies not updated on save]: Required by a consuming product. Requires a patch for 4.5.0. |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=236422 Refresh proxies for a re/opened project.]: Required by a consuming product. |
− | ** | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=239285 Unable to delete some projects in Test Perspective] |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=237945 'Save as' option doesn't support test execution result] |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=238236 Duplicate execution time in .execution file in Test Perspective] |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=228260 Changing the file name of a test asset in the Test Navigator updates the logical name.] |
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=237940 Rename error in Java perspective with test assets created in Test perspective] | ||
+ | ** Paul: | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=239953 Test Navigator does not support the Delete/Del key.]: Required by a consuming product. | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=87285 Automated Test Execution Harness Tests] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=204849 AGR test suites model disabled test invocations incorrectly.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=147859 IExecutionDeploymentAdapter.cleanUpTestAssets no longer called] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=216806 Test Navigator action OpenReportAction is hardcoded, not defined in an extension] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=213344 Test log viewer does not display extended properties.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=215078 Test Execution Tabular Report contains empty or incorrect child reports.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=228241 Provide ISV documentation for enhancement 166025.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=239660 When i try to open a TPTP Junit test result it gives me an error "Could not open the editor: An unexpected exception was thrown."] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=123650 HTTP tests do not automatically generate JUnit Java code like JUnit tests.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=151919 Test Log Viewer does not show test suite/invocation hyperlinks after a test execution event is displayed.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=212415 WidgetFactory automatically scrolls to the right.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=239394 Cannot scroll to the bottom of the log file in log viewer events page] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=200237 Can not debug launched eclipse process via ASF without rebuilding TPTP jar] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=216427 Unable to associate multiple TestCases with an artifact] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=210718 Test execution node in the events tree is missing a Defects pane] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=239287 Create TPTP JUnit test suites for test model test classes.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=133099 Providing the ability to record user's interactions with GEF objects in a GEF editor] | ||
** Tony: | ** Tony: | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=195203 Accessibility-Need shortcuts for all Test Navigator pulldowns]: Required by a consuming product. |
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170651 (Test Automation) Automate manual test suites using the Automated GUI Recorder.] |
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170654 (Test Automation) Automate manual test suites using the Automated GUI Recorder.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170656 (Test Automation) Automate manual test suites using the Automated GUI Recorder.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=213446 Test Log Viewer AGR test suites do not run.] | ||
== 4.5.2 == | == 4.5.2 == | ||
Line 203: | Line 183: | ||
* As of June 25 (TPTP 4.5.0 Ganymede), Duwayne has moved off of TPTP and the Test Project. | * As of June 25 (TPTP 4.5.0 Ganymede), Duwayne has moved off of TPTP and the Test Project. | ||
− | ** Thanks to Duwayne for contribution to the project since | + | ** Thanks to Duwayne for contribution to the project since 2003. |
** Duwayne's defects/enhancements have been reassigned to Paul. | ** Duwayne's defects/enhancements have been reassigned to Paul. | ||
− | ** Duwayne will nominate Paul on the [mailto:tptp-testing-tools-dev@eclipse.org | + | ** Duwayne will nominate Paul on the [mailto:tptp-testing-tools-dev@eclipse.org Test Project mailing list] as the Component Lead for the following components: |
*** Test.Agents.Recorder | *** Test.Agents.Recorder | ||
*** Test.Execution.AutoGUIRunner | *** Test.Execution.AutoGUIRunner | ||
Line 213: | Line 193: | ||
*** ASF.Runtime | *** ASF.Runtime | ||
*** Documentation (ASF) | *** Documentation (ASF) | ||
+ | ** Paul will update the [http://www.eclipse.org/tptp/home/project_info/structure/TPTP_Project_Info.html TPTP Project Matrix] with the changes once voting is complete. | ||
+ | |||
+ | * As of June 25 (TPTP 4.5.0 Ganymede), Paul is working 50% on TPTP and the Test Project. | ||
+ | ** Eugene Chan has assumed the position as TPTP AG Lead. | ||
+ | ** Paul will focussed on his defect load in 4.5.1/4.5.2, with Joanna assuming the planning/project management responsibilities for the Test Project. | ||
+ | *** Paul will continue to provide technical/planning/project management leadership for the Test Project. | ||
+ | *** We will continue the weekly Test Project calls until the transition is complete. | ||
== Round-table == | == Round-table == | ||
Line 219: | Line 206: | ||
* Last Week: | * Last Week: | ||
+ | ** Out of office: 2 days | ||
** Resolved defects: | ** Resolved defects: | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=238099 Variable type in DataPool can be typed manually by user] |
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=239256 Revise release note for IPv6 HTTP Recording] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=239232 Text associated with deleting datapool's popup window needs to be improved.] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=221097 TPTP EMF models needs to update] | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=141416 Generic Recorder wizard should preset wizard selection based on previous page selections] | ||
* This Week: | * This Week: | ||
Line 228: | Line 220: | ||
* Last Week: | * Last Week: | ||
+ | ** Tested IPv6. | ||
+ | ** Out of office: 3 days | ||
* This Week: | * This Week: | ||
Line 236: | Line 230: | ||
* Last Week: | * Last Week: | ||
** Resolved defects: | ** Resolved defects: | ||
− | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id= | + | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=238838 The File is missing in Test Navigator after rename it with an exteremely long name] |
* This Week: | * This Week: | ||
Line 245: | Line 239: | ||
* Last Week: | * Last Week: | ||
+ | ** Out of office: 2 days | ||
+ | ** Test automation. | ||
* This Week: | * This Week: | ||
Line 263: | Line 259: | ||
*** ASF.Runtime | *** ASF.Runtime | ||
*** Documentation (ASF) | *** Documentation (ASF) | ||
+ | ** Post the [http://wiki.eclipse.org/TPTP_Test_Tools_Project_Meetings meeting minutes] for the June 16, 23, 30 meetings. | ||
* Jerome: | * Jerome: | ||
Line 272: | Line 269: | ||
== Notes == | == Notes == | ||
− | * Thanks to | + | * Thanks to Duwayne for covering the Test Project calls for the last three Mondays (June 16, 23, 30) during Paul's absence. |
− | + | ||
== Reminders == | == Reminders == |
Latest revision as of 08:58, 8 July 2008
Contents
Attendees
- Present:
- Paul Slauenwhite
- Tony Wang
- Jerome Bozier
- DuWayne Morris
4.5
Release Information
- 4.5 has shipped with the Ganymede Simultaneous Release on June 25, 2008.
- Congratulations and thanks to all of the Test Project committers!
Release Summary
- 226 new Bugzillas opened:
- Test Project originated4: 142
- TPTP (other sub-projects) originated: 33
- Community originated: 51
- Unresolved: 49
- Fixed: 130
- Invalid: 5
- Won't fix1: 7
- Duplicate: 22
- Works for me: 13
- 399 Bugzillas resolved:
- Fixed: 199
- Invalid: 10
- Won't fix1: 116
- Duplicate: 38
- Works for me: 35
- Not Eclipse: 1
- 221 old Bugzillas resolved:
- Fixed: 69
- Invalid: 5
- Won't fix1: 109
- Duplicate: 16
- Works for me: 22
- Fixed defects by committer:
- Paul (100%): 154 (614.5 PH)
- Jerome (50%): 21 (469.75 PH)
- Duwayne (90%): 17 (312.5 PH)
- Tony2 (100%): 4 (42.5 PH)
- Other3: 3 (807.1 PH)
- 4 enhancements delivered.
- 48.5% increase in our test bucket:
- 4.4.0: 400 tests
- 4.5.0: 594 tests
- Ongoing work:
- Executing the Test Project Tests for each test pass.
- Parallel release TPTP 4.4.1.
- News group and mailing list posts.
- Triage new defects.
1: Existing and new defects opened against the As-Is Components are returned as WONTFIX.
2: Co-op new on TPTP as of January 1, 2008.
3: 803 PH contributed by non-committer resources for enhancement 202695.
4: As a result of increased internal project testing.
4.5.1
Release Information
- 4.5.1 will ship with the Ganymede Service Release 1 or SR1 (target release date: September 24, 2008).
Where are we at?
- We have completed 1.5 weeks of development.
- We have 5.5 weeks of development remaining (target: August 12).
Defects
- Platform Project defects impacting the Test Project:
- Major:
- Bugzillas (in order of completion):
- Jerome:
- Test Navigator deadlocks in UI thread
- CoreExpcetion thrown when renaming a test that has just been pasted: Required by a consuming product. Requires a patch for 4.5.0.
- Test asset depenencies not updated on save: Required by a consuming product. Requires a patch for 4.5.0.
- Refresh proxies for a re/opened project.: Required by a consuming product.
- Unable to delete some projects in Test Perspective
- 'Save as' option doesn't support test execution result
- Duplicate execution time in .execution file in Test Perspective
- Changing the file name of a test asset in the Test Navigator updates the logical name.
- Rename error in Java perspective with test assets created in Test perspective
- Paul:
- Test Navigator does not support the Delete/Del key.: Required by a consuming product.
- Automated Test Execution Harness Tests
- AGR test suites model disabled test invocations incorrectly.
- IExecutionDeploymentAdapter.cleanUpTestAssets no longer called
- Test Navigator action OpenReportAction is hardcoded, not defined in an extension
- Test log viewer does not display extended properties.
- Test Execution Tabular Report contains empty or incorrect child reports.
- Provide ISV documentation for enhancement 166025.
- When i try to open a TPTP Junit test result it gives me an error "Could not open the editor: An unexpected exception was thrown."
- HTTP tests do not automatically generate JUnit Java code like JUnit tests.
- Test Log Viewer does not show test suite/invocation hyperlinks after a test execution event is displayed.
- WidgetFactory automatically scrolls to the right.
- Cannot scroll to the bottom of the log file in log viewer events page
- Can not debug launched eclipse process via ASF without rebuilding TPTP jar
- Unable to associate multiple TestCases with an artifact
- Test execution node in the events tree is missing a Defects pane
- Create TPTP JUnit test suites for test model test classes.
- Providing the ability to record user's interactions with GEF objects in a GEF editor
- Tony:
- Accessibility-Need shortcuts for all Test Navigator pulldowns: Required by a consuming product.
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.
- Test Log Viewer AGR test suites do not run.
- Jerome:
4.5.2
Release Information
- 4.5.2 will ship with the Ganymede Service Release 2 or SR2 (target release date: February 25, 2009).
Test Automation Initiative
- Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
- For more information, see the WIKI page.
- To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
- Outstanding defects include:
- Paul:
- JUnit and JUnit Plug-in test execution add incorrect elements to the plugin.xml file.
- AGR Tests require absolute path to Equinox JAR
- Clear remote workspace launch does not work for remote test execution
- AGR Tests cannot be run with start ACServer
- Test Execution Tabular Report contains empty or incorrect child reports.
- IExecutionDeploymentAdapter.cleanUpTestAssets no longer called
- AbstractTestExecutionService – “Process was null -- test completed too fast?” message
- Connection property does not deploy all dependencies
- Test Execution fails when project defined incorrectly - ResourceException
- Connection property does not allow JUnit Plug-in Tests to be executed
- ASF marshalling return value between service and client adapter does not have support for failures / exceptions
- Confusing exceptions when running automated services.
- ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
- ANT test results property requires trailing slash to specify location
- Exceptions when running ASF tasks.
- Only the name of the execution result is used from the results property.
- Paul:
Miscellaneous
- As of June 25 (TPTP 4.5.0 Ganymede), Duwayne has moved off of TPTP and the Test Project.
- Thanks to Duwayne for contribution to the project since 2003.
- Duwayne's defects/enhancements have been reassigned to Paul.
- Duwayne will nominate Paul on the Test Project mailing list as the Component Lead for the following components:
- Test.Agents.Recorder
- Test.Execution.AutoGUIRunner
- Test.Execution.URLRunner
- Test.UI.AutoGUIUI
- Test.UI.URLTest
- ASF.Runtime
- Documentation (ASF)
- Paul will update the TPTP Project Matrix with the changes once voting is complete.
- As of June 25 (TPTP 4.5.0 Ganymede), Paul is working 50% on TPTP and the Test Project.
- Eugene Chan has assumed the position as TPTP AG Lead.
- Paul will focussed on his defect load in 4.5.1/4.5.2, with Joanna assuming the planning/project management responsibilities for the Test Project.
- Paul will continue to provide technical/planning/project management leadership for the Test Project.
- We will continue the weekly Test Project calls until the transition is complete.
Round-table
Paul
- Last Week:
- Out of office: 2 days
- Resolved defects:
- This Week:
- Defects.
Duwayne
- Last Week:
- Tested IPv6.
- Out of office: 3 days
- This Week:
- Action items.
Jerome
- Last Week:
- This Week:
- Action items.
- Defects.
Tony
- Last Week:
- Out of office: 2 days
- Test automation.
- This Week:
- Action items.
- Defects.
Action items
- Duwayne:
- Verify/close your resolved defects.
- Reply to the question in jdt.ui bundle activator assumes PlatformUI.getWorkbench(), causing autobuild failure when running headless.
- Nominate Paul on the TPTP mailing list as the Component Lead for the following components:
- Test.Agents.Recorder
- Test.Execution.AutoGUIRunner
- Test.Execution.URLRunner
- Test.UI.AutoGUIUI
- Test.UI.URLTest
- ASF.Runtime
- Documentation (ASF)
- Post the meeting minutes for the June 16, 23, 30 meetings.
- Jerome:
- Verify/close your resolved defects.
- Tony:
- Verify/close your resolved defects.
Notes
- Thanks to Duwayne for covering the Test Project calls for the last three Mondays (June 16, 23, 30) during Paul's absence.
Reminders
Lead Committers
- Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
- Add the Original Estimate (PH) when triaging a new defect.
- Update the Hours Worked (PH) when completing a defect.
- Test their components or review/track testing contributed by other committers/resources.
- Monitor the TPTP news group and answer posts specific to their Test Project components.
- Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
- Use the MyFoundation Portal for committer elections.