Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "TPTP-Test-Tools-20080707"
(→4.5) |
|||
Line 119: | Line 119: | ||
=== Release Summary === | === Release Summary === | ||
+ | |||
+ | == 4.5.1 == | ||
+ | |||
+ | === Release Information === | ||
+ | |||
+ | * 4.5.1 will ship with the Ganymede Service Release 1 or SR1 (target release date: September 24, 2008). | ||
+ | |||
+ | * [http://www.eclipse.org/tptp/home/project_info/releaseinfo/4.5.1/schedule.html Detailed Schedule.] | ||
+ | |||
+ | * [http://www.eclipse.org/tptp/reports/bugs/report_451.php?src=All&queryType=bugs&component=All Defect queries.] | ||
+ | |||
+ | * [http://www.eclipse.org/tptp/home/downloads/?ver=4.5.1 Download.] | ||
+ | |||
+ | * [http://www.eclipse.org/tptp/reports/test/testpass_451.php?source=All Test reports.] | ||
+ | |||
+ | === Where are we at? === | ||
+ | |||
+ | * We have completed 1.5 weeks of development. | ||
+ | |||
+ | * We have 5.5 weeks of development remaining (target: August 12). | ||
+ | |||
+ | === Defects === | ||
+ | |||
+ | * [http://www.eclipse.org/tptp/reports/bugs/report_451.php?src=All&queryType=bugs&component=Test Queries.] | ||
+ | |||
+ | * Platform Project defects impacting the Test Project: | ||
+ | ** Major: | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222382 Execution of any testsuite fails using the IAC - InactiveProcessException]: Targeted to I8. | ||
+ | |||
+ | * Bugzillas: | ||
+ | ** Paul: | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=214388 Clean-up the TPTP committer lists and project matrix.]: Platform Project defect. | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=133099 Providing the ability to record user's interactions with GEF objects in a GEF editor]: Paul will complete the integration, testing, and check-in this week now that I8 TP2 AGR tests have been completed. | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=87285 Automated Test Execution Harness Tests]: Test automation defect. | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=135103 All external APIs should have JUnit tests]: Test automation defect. | ||
+ | ** Duwayne: | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222382 Execution of any testsuite fails using the IAC - InactiveProcessException]: Platform Project defect. | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170654 (Test Automation) Automate manual test suites using the Automated GUI Recorder.]: Test automation defect. | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170656 (Test Automation) Automate manual test suites using the Automated GUI Recorder.]: Test automation defect. | ||
+ | ** Tony: | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=213446 (Linux) AGR test suite does not run.]: Test automation defect. | ||
+ | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=170651 (Test Automation) Automate manual test suites using the Automated GUI Recorder.]: Test automation defect | ||
+ | |||
+ | == 4.5.2 == | ||
+ | |||
+ | === Release Information === | ||
+ | |||
+ | * 4.5.2 will ship with the Ganymede Service Release 2 or SR2 (target release date: February 25, 2009). | ||
+ | |||
+ | * [http://www.eclipse.org/tptp/home/project_info/releaseinfo/4.5.2/schedule.html Detailed Schedule.] | ||
+ | |||
+ | * [http://www.eclipse.org/tptp/reports/bugs/report_452.php?src=All&queryType=bugs&component=All Defect queries.] | ||
+ | |||
+ | * [http://www.eclipse.org/tptp/home/downloads/?ver=4.5.2 Download.] | ||
+ | |||
+ | * [http://www.eclipse.org/tptp/reports/test/testpass_452.php?source=All Test reports.] | ||
+ | |||
+ | == Test Automation Initiative == | ||
+ | |||
+ | * Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure: | ||
+ | ** For more information, see the [http://wiki.eclipse.org/4.5_Test_Automation_Initiative WIKI page]. | ||
+ | ** To see the BVT results for a specific build, open the [http://www.eclipse.org/tptp/home/downloads/?ver=4.5.0 Build Reports] page for a specific build and select BVT Results. | ||
+ | ** Outstanding defects include: | ||
+ | *** Paul: | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=219041 JUnit and JUnit Plug-in test execution add incorrect elements to the plugin.xml file.] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222759 AGR Tests require absolute path to Equinox JAR] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222760 Clear remote workspace launch does not work for remote test execution] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=222761 AGR Tests cannot be run with start ACServer] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=215078 Test Execution Tabular Report contains empty or incorrect child reports.] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=147859 IExecutionDeploymentAdapter.cleanUpTestAssets no longer called] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=221303 AbstractTestExecutionService – “Process was null -- test completed too fast?” message] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=220390 Connection property does not deploy all dependencies] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233676 Test Execution fails when project defined incorrectly - ResourceException] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=220391 Connection property does not allow JUnit Plug-in Tests to be executed] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=194503 ASF marshalling return value between service and client adapter does not have support for failures / exceptions] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=217487 Confusing exceptions when running automated services.] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=200194 ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=210289 ANT test results property requires trailing slash to specify location] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=210292 Exceptions when running ASF tasks.] | ||
+ | **** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=218157 Only the name of the execution result is used from the results property.] | ||
+ | |||
+ | == Miscellaneous == | ||
+ | |||
+ | * As of June 25 (TPTP 4.5.0 Ganymede), Duwayne has moved off of TPTP and the Test Project. | ||
+ | ** Thanks to Duwayne for contribution to the project since 2004. | ||
+ | ** Duwayne's defects/enhancements have been reassigned to Paul. | ||
+ | ** Duwayne will nominate Paul on the [mailto:tptp-testing-tools-dev@eclipse.org TPTP mailing list] as the Component Lead for the following components: | ||
+ | *** Test.Agents.Recorder | ||
+ | *** Test.Execution.AutoGUIRunner | ||
+ | *** Test.Execution.URLRunner | ||
+ | *** Test.UI.AutoGUIUI | ||
+ | *** Test.UI.URLTest | ||
+ | *** ASF.Runtime | ||
+ | *** Documentation (ASF) | ||
== Round-table == | == Round-table == | ||
Line 125: | Line 219: | ||
* Last Week: | * Last Week: | ||
− | |||
− | |||
** Resolved defects: | ** Resolved defects: | ||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233137 Unable to publish BIRT reports through ASF] | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=233137 Unable to publish BIRT reports through ASF] | ||
− | |||
− | |||
* This Week: | * This Week: | ||
− | ** | + | ** Defects. |
− | + | ||
− | + | ||
=== Duwayne === | === Duwayne === | ||
* Last Week: | * Last Week: | ||
− | |||
− | |||
− | |||
− | |||
* This Week: | * This Week: | ||
** Action items. | ** Action items. | ||
− | |||
− | |||
=== Jerome === | === Jerome === | ||
Line 155: | Line 237: | ||
** Resolved defects: | ** Resolved defects: | ||
*** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=235210 Loading error messages and deadlocking in TestNav] | *** [https://bugs.eclipse.org/bugs/show_bug.cgi?id=235210 Loading error messages and deadlocking in TestNav] | ||
− | |||
− | |||
− | |||
− | |||
* This Week: | * This Week: | ||
− | ** | + | ** Action items. |
+ | ** Defects. | ||
=== Tony === | === Tony === | ||
* Last Week: | * Last Week: | ||
− | |||
− | |||
− | |||
* This Week: | * This Week: | ||
− | ** | + | ** Action items. |
− | ** | + | ** Defects. |
− | + | ||
== Action items == | == Action items == | ||
* Duwayne: | * Duwayne: | ||
− | ** | + | ** Verify/close your [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=TPTP&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=RESOLVED&emailreporter1=1&emailtype1=substring&email1=dmorris@us.ibm.com&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= resolved defects]. |
− | ** | + | ** Reply to the question in [https://bugs.eclipse.org/bugs/show_bug.cgi?id=199135#c7 jdt.ui bundle activator assumes PlatformUI.getWorkbench(), causing autobuild failure when running headless]. |
− | ** | + | ** Nominate Paul on the [mailto:tptp-testing-tools-dev@eclipse.org TPTP mailing list] as the Component Lead for the following components: |
− | + | *** Test.Agents.Recorder | |
− | * | + | *** Test.Execution.AutoGUIRunner |
− | ** | + | *** Test.Execution.URLRunner |
+ | *** Test.UI.AutoGUIUI | ||
+ | *** Test.UI.URLTest | ||
+ | *** ASF.Runtime | ||
+ | *** Documentation (ASF) | ||
* Jerome: | * Jerome: | ||
− | ** Verify/close your [ | + | ** Verify/close your [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=TPTP&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=RESOLVED&emailreporter1=1&emailtype1=substring&email1=jerome.bozier@fr.ibm.com&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= resolved defects]. |
+ | |||
+ | * Tony: | ||
+ | ** Verify/close your [https://bugs.eclipse.org/bugs/buglist.cgi?query_format=advanced&short_desc_type=allwordssubstr&short_desc=&classification=TPTP&long_desc_type=allwordssubstr&long_desc=&bug_file_loc_type=allwordssubstr&bug_file_loc=&status_whiteboard_type=allwordssubstr&status_whiteboard=&keywords_type=allwords&keywords=&bug_status=RESOLVED&emailreporter1=1&emailtype1=substring&email1=tcwang@ca.ibm.com&emailtype2=substring&email2=&bugidtype=include&bug_id=&votes=&chfieldfrom=&chfieldto=Now&chfieldvalue=&cmdtype=doit&order=Reuse+same+sort+as+last+time&field0-0-0=noop&type0-0-0=noop&value0-0-0= resolved defects]. | ||
== Notes == | == Notes == | ||
− | * Paul will be out of the office for next three Mondays (June 16, 23, 30). | + | * Thanks to Paul will be out of the office for next three Mondays (June 16, 23, 30). |
** Duwayne will host the Test Project calls. | ** Duwayne will host the Test Project calls. | ||
Revision as of 08:41, 7 July 2008
Contents
Attendees
- Present:
- Paul Slauenwhite
- Tony Wang
- Jerome Bozier
- DuWayne Morris
4.5
Release Information
- 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 25, 2008).
Where are we at?
- RC3 was delivered on Tuesday, June 3.
- We have completed the I8 TP2.
- RC4 (final RC) was originally scheduled for Friday, June 6.
- It has been delayed until the official RC4 date for +3 projects (Wednesday, June 11).
- On last week's AG call, we discussed the possibility of a point release (e.g. 4.5.0.1) to resolve defects that cannot be contained in 4.5.0 but are required by the community or a consuming product.
- We are attempting to eliminate the need for a point release (e.g. 4.5.0.1) by delaying RC4 (final RC) to resolve the remaining defects required by the community or a consuming product.
- Agenda for this week:
- Resolve the remaining I8 defects.
- Smoke test the RC4 candidate driver.
- Verify/close our resolved defects.
Defect Verification
- A note has been sent to the originators of all resolved defects reminding them to verify/close these defects before Ganymede releases.
News Group
- The following news group posts require a reply:
- Duwayne:
- Re: HTTP Recording stops immediately after start-up (FireFox) or never records data (IE) (March 25, 2008 1:15 PM)
- Re: NoClassDefFoundError: org.eclipse.hyades.test.common...? (April 10, 2008 5:33 PM)
- How to record Properties View values (Property <-> Value pair) ??? (June 9, 2008 8:12 AM)
- Duwayne:
Test Automation Initiative
- Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
- For more information, see the WIKI page.
- To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
- Outstanding defects include:
- Paul:
- JUnit and JUnit Plug-in test execution add incorrect elements to the plugin.xml file.
- AGR Tests require absolute path to Equinox JAR
- Clear remote workspace launch does not work for remote test execution
- AGR Tests cannot be run with start ACServer
- Test Execution Tabular Report contains empty or incorrect child reports.
- IExecutionDeploymentAdapter.cleanUpTestAssets no longer called
- Duwayne:
- AbstractTestExecutionService – “Process was null -- test completed too fast?” message
- Connection property does not deploy all dependencies
- Test Execution fails when project defined incorrectly - ResourceException
- Connection property does not allow JUnit Plug-in Tests to be executed
- ASF marshalling return value between service and client adapter does not have support for failures / exceptions
- Confusing exceptions when running automated services.
- ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
- ANT test results property requires trailing slash to specify location
- Exceptions when running ASF tasks.
- Only the name of the execution result is used from the results property.
- Paul:
Enhancements
- Alexander Nyßen:
- Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. AG/PMC approved and Contribution Questionnaire (CQ) approved. Since we will be running AGR test suites to smoke test the RC5 candidate, Paul will complete the integration, testing, and check-in after RC5 has dropped (target: June 17). This enhancement requires updates to the AGR user guide for the outstanding function (see Support capturing additional draw2d related events when recording user's interactions with a GEF editor).
Defects
- Defects require a reply:
- Platform Project defects impacting the Test Project:
- Critical/Blocker:
- Random intermitten errors while launching a test against remote agents: Targeted to I8.
- command line and runtime workbench unsatisfied link error: Targeted to I8.
- Major/Normal:
- Critical/Blocker:
- Remaining I8 Bugzillas:
- Paul:
- Clean-up the TPTP committer lists and project matrix.: Platform Project defect.
- Providing the ability to record user's interactions with GEF objects in a GEF editor: Paul will complete the integration, testing, and check-in this week now that I8 TP2 AGR tests have been completed.
- Automated Test Execution Harness Tests: Test automation defect.
- All external APIs should have JUnit tests: Test automation defect.
- Duwayne:
- Execution of any testsuite fails using the IAC - InactiveProcessException: Platform Project defect.
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation defect.
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation defect.
- Tony:
- (Linux) AGR test suite does not run.: Test automation defect.
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation defect
- Paul:
Release Summary
4.5.1
Release Information
- 4.5.1 will ship with the Ganymede Service Release 1 or SR1 (target release date: September 24, 2008).
Where are we at?
- We have completed 1.5 weeks of development.
- We have 5.5 weeks of development remaining (target: August 12).
Defects
- Platform Project defects impacting the Test Project:
- Major:
- Bugzillas:
- Paul:
- Clean-up the TPTP committer lists and project matrix.: Platform Project defect.
- Providing the ability to record user's interactions with GEF objects in a GEF editor: Paul will complete the integration, testing, and check-in this week now that I8 TP2 AGR tests have been completed.
- Automated Test Execution Harness Tests: Test automation defect.
- All external APIs should have JUnit tests: Test automation defect.
- Duwayne:
- Execution of any testsuite fails using the IAC - InactiveProcessException: Platform Project defect.
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation defect.
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation defect.
- Tony:
- (Linux) AGR test suite does not run.: Test automation defect.
- (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation defect
- Paul:
4.5.2
Release Information
- 4.5.2 will ship with the Ganymede Service Release 2 or SR2 (target release date: February 25, 2009).
Test Automation Initiative
- Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
- For more information, see the WIKI page.
- To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
- Outstanding defects include:
- Paul:
- JUnit and JUnit Plug-in test execution add incorrect elements to the plugin.xml file.
- AGR Tests require absolute path to Equinox JAR
- Clear remote workspace launch does not work for remote test execution
- AGR Tests cannot be run with start ACServer
- Test Execution Tabular Report contains empty or incorrect child reports.
- IExecutionDeploymentAdapter.cleanUpTestAssets no longer called
- AbstractTestExecutionService – “Process was null -- test completed too fast?” message
- Connection property does not deploy all dependencies
- Test Execution fails when project defined incorrectly - ResourceException
- Connection property does not allow JUnit Plug-in Tests to be executed
- ASF marshalling return value between service and client adapter does not have support for failures / exceptions
- Confusing exceptions when running automated services.
- ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
- ANT test results property requires trailing slash to specify location
- Exceptions when running ASF tasks.
- Only the name of the execution result is used from the results property.
- Paul:
Miscellaneous
- As of June 25 (TPTP 4.5.0 Ganymede), Duwayne has moved off of TPTP and the Test Project.
- Thanks to Duwayne for contribution to the project since 2004.
- Duwayne's defects/enhancements have been reassigned to Paul.
- Duwayne will nominate Paul on the TPTP mailing list as the Component Lead for the following components:
- Test.Agents.Recorder
- Test.Execution.AutoGUIRunner
- Test.Execution.URLRunner
- Test.UI.AutoGUIUI
- Test.UI.URLTest
- ASF.Runtime
- Documentation (ASF)
Round-table
Paul
- Last Week:
- Resolved defects:
- This Week:
- Defects.
Duwayne
- Last Week:
- This Week:
- Action items.
Jerome
- Last Week:
- Resolved defects:
- This Week:
- Action items.
- Defects.
Tony
- Last Week:
- This Week:
- Action items.
- Defects.
Action items
- Duwayne:
- Verify/close your resolved defects.
- Reply to the question in jdt.ui bundle activator assumes PlatformUI.getWorkbench(), causing autobuild failure when running headless.
- Nominate Paul on the TPTP mailing list as the Component Lead for the following components:
- Test.Agents.Recorder
- Test.Execution.AutoGUIRunner
- Test.Execution.URLRunner
- Test.UI.AutoGUIUI
- Test.UI.URLTest
- ASF.Runtime
- Documentation (ASF)
- Jerome:
- Verify/close your resolved defects.
- Tony:
- Verify/close your resolved defects.
Notes
- Thanks to Paul will be out of the office for next three Mondays (June 16, 23, 30).
- Duwayne will host the Test Project calls.
Reminders
Lead Committers
- Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
- Add the Original Estimate (PH) when triaging a new defect.
- Update the Hours Worked (PH) when completing a defect.
- Test their components or review/track testing contributed by other committers/resources.
- Monitor the TPTP news group and answer posts specific to their Test Project components.
- Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
- Use the MyFoundation Portal for committer elections.