Notice: this Wiki will be going read only early in 2024 and edits will no longer be possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
TPTP-Test-Tools-20071022
Attendees
- Present:
- Paul Slauenwhite
- Jerome Gout
- Jerome Bozier
- DuWayne Morris
- Joseph Toomey
- Absent:
- Kent Siefkes - conflict
- Kendric Wang
4.4.1
- 4.4.1 will ship with the Europa Winter Maintenance Release (target release date: February 29, 2008).
- All defects will require project/PMC approval.
- Release Engineering has split CVS streams (4.4.1 and 4.5 (HEAD)). Any fixes checked-in to the 4.4.1 stream MUST be checked-in to HEAD.
- Outstanding defect(s):
- 168597([Vista] HTTP Recorder requires work-around on Windows Vista) for inclusion in the new 4.4.1 deliverable. A summary of the issues and fix is at 168597. Joe and Paul have reviewed the patches. Duwayne will request project approval (requires a Stop Ship Template), update the final hours worked, and check in the patch to both the TPTP-4_1_1 and HEAD streams once PMC approval has been granted.
- After a review of the API report for 4.4.1, the following class was added:
- ImportExistingProjects.java
- Joe will open defect and request project/PMC approval to add the @provisional tag (see the TPTP API Contract).
- There will be a smoke test pass in the next few weeks (target date: TBD) aligned with the latest release of the IBM 1.5 JRE.
- Joe noted that the dependency links for the 4.4.1 candidate driver are broken. This has been noted in defect 205040, opened to monitor/resolve broken links on the TPTP web site.
4.5
- 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).
- Staffing:
- For 4.5, the following committers will be working on the Test Project:
- Paul
- Duwayne
- TDB (e.g. co-op)
- Jerome B. (50%)
- Joe, Bianca, and Kent, Jerome G. (advisory role or sporadic contribution)
- Given the changes in staffing for 4.5, the following component changes are proposed:
- Note: Current Component Leads maintain their committer status as developer committers for the component.
- For 4.5, the following committers will be working on the Test Project:
| Bugzilla Component | Current Component Lead | Proposed Component Lead |
|---|---|---|
| Platform.UI.Reporting | Sheldon Lee-Loy | Paul Slauenwhite |
| Test.Agents | Mark D Dunn | Paul Slauenwhite |
| Test.Agents.ComptestAgent | Joseph P Toomey | Paul Slauenwhite |
| Test.Agents.Recorder | Mark D Dunn | Duwayne Morris |
| Test.Analysis | Joseph P Toomey | [remove] |
| ASF.Documentation | Joseph P Toomey | Duwayne Morris |
| Test.Execution | Kent Siefkes | Paul Slauenwhite |
| Test.Execution.AutoGUIRunner | Liz Dancy | Duwayne Morris |
| Test.Execution.CommonRunner | Joseph P Toomey | Paul Slauenwhite |
| Test.Execution.ExecutionHarness | Joseph P Toomey | Paul Slauenwhite |
| Test.Execution.JUnitRunner | Joseph P Toomey | Paul Slauenwhite |
| ASF.Runtime | Joseph P Toomey | Duwayne Morris |
| Test.Model | Joseph P Toomey | Paul Slauenwhite |
| Test.UI.AutoGUIUI | Liz Dancy | Duwayne Morris |
| Test.UI.Charting | Sheldon Lee-Loy | [remove] |
| Test.UI.CodeCoverage | Eugene Chan | [remove] |
| Test.UI.JUnit | Jerome Gout | Paul Slauenwhite |
| Test.UI.Reporting | Jerome Gout | Paul Slauenwhite |
| Test.UI.URLTest | Mark D Dunn | Duwayne Morris |
- As discussed at the TPTP F-2-F, we are proposing the following to the PMC to accommodate the decrease in resources for 4.5:
- Isolating and moving Manual Test to Technology Preview.
- Smoke testing the Technology Previews (Manual Test, API Recorder, and AGR) per iteration and maintenance release.
- Fixing only critical and blocking defects for the Technology Previews (Manual Test, API Recorder, and AGR).
- Reduced user support (news group and mailing list posts) for the Technology Previews (Manual Test, API Recorder, and AGR).
- Focus on GA function for TPTP/Test Project presentations (e.g. EclipseCon 2008).
- Enhancements:
- The following AG-approved enhancements will requested for PG/PMC approval:
- 202695 Encrypted datapool variable support: Will be completed by a non-committer from IBM (Xin Ying Huang). Paul and Joe are working with Xin Ying to review the design.
- 162605 Test execution should support parallel execution of tests: Will be completed by Duwayne, with limited assistance from Joe. Duwayne is reviewing the enhancement and Description Document this week in preparation for discussing the proposed design next week.
- 166025 Move, Copy, Delete, Rename and Import/Export test assets.: Jerome G. has scheduled a public call for this week to revisit this topic, design, and implementation for transitioning to Jerome B. and review for others.
- 145146 Generic Recorder Framework improvements.: Paul is reviewing the enhancement and Description Document this week in preparation for discussing the proposed design next week.
- Once these enhancements are approved by the PG/PMC, we will start the design reviews (next week). Please start the design work this week.
- The following AG-approved enhancements will requested for PG/PMC approval:
- Current defects:
- 107432 (Test) IPv6 support in URL Test HTTP Recorder (required by Platform enhancement 165409): Duwayne is still waiting to hear back from the IBM Test Team to schedule time on an internal IPv6 network for testing.
- 199237 (Test) [Java 6] Test execution stalls at 36%. (required by Platform enhancement 200535): Closed as WORKSFORME.
- 200194 ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results.: Duwayne is investigating.
- 123650 [Usability] HTTP tests do not automatically generate JUnit Java code like JUnit tests.: Duwayne is investigating.
- 171083 AGR Recorder does not distinguish between two controls on the same panel if they have the same text and type: Paul is investigating.
- 187864 Skewed completion rates in BIRT test reports.: Paul is finishing the implementation.
- 206355 [Usability] Switch to Test Perspective after test execution.: Paul is investigating.
- 206356 [Usability] Switch to Test Perspective after creating a test asset.: Paul is investigating.
- The remaining test automation defects from 4.4:
- Duwayne:
- Paul:
- Jerome:
- 170651: Will be completed by Jerome B. early in 4.5. Work-around required until 171083 is resolved.
- 170653: Will be completed by Jerome B. early in 4.5. Paul has provided some AGR test suites created from the Test Navigator manual test suites for review. Once reviewed, please check them into CVS (HEAD), remove the manual test suites that they cover from the behavior AllManualTests.testsuite (and AllManualSmokeTests.testsuite), and add the new AGR tests to the behavior of AllGUITests.testsuite (and AllGUISmokeTests.testsuite).
- 144950 [Scalability] Address TPTP EMF model scalability problems: Although withdrawn as a 4.5 candidate enhancement, the outcome/status of the work done in 4.4 on this enhancement was not updated in the WIKI page. Joe will update the WIKI this week.
- Test project topics for upcoming AG calls include:
- Enhancement 166025 (Move, Copy, Delete, Rename and Import/Export test assets) as it relates to the other EMF models in TPTP.
- The effort by the Release Engineering Team on consolidating our testing process and automation infrastructure.
- The effort by the Release Engineering Team on integrating EMMA with our build process.
Roundtable
- Status updates and summary of defects, blocking issues, and architectural issues/concerns that we will focus on completing the upcoming week:
- Paul:
- 4.5 AG Reviews completed.
- Travel/vacation 3 days last week.
- Attending/demoing @ CASCON 2007 this week.
- Review and start design of enhancement 145146.
- Jerome B.:
- Automating Test Perspective/Navigator manual tests.
- Reviewing/migrating existing AGR tests for the Test Perspective/Navigator.
- Review and start design of enhancement 166025.
- Jerome G.:
- Preparing for review call on enhancement 166025.
- Assisting Jerome B.
- DuWayne:
- Joe:
- Reviewing design for enhancement 202695.
- Preparation for EclipseWorld 2007.
- News group posts.
- Paul:
Action items
- n/a
Notes
- Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure including:
- Committers responsible for automating their manual tests.
- Defining a common process and automation framework
- Running the automated tests on the automation framework
- Integrate the automation framework with the build framework (BVT).
- Paul and the Release Engineering Team (Joel) are working on integrating EMMA with our build process (generating statically instrumented 'EMMA' drivers for testing with code coverage enabled), which we will use in the 4.4.1/4.5 test passes.
- EclipseCon 2008:
- Reminder to participate in EclipseCon 2008 by proposing a talk or tutorial for the Test and Performance category. This category covers topics related to test and performance tooling that leverage Eclipse. Test and Performance tooling is used throughout the software development and test life cycle, from early unit testing, profiling, and tuning to post-deployment monitoring, tracing, and log analysis. This category is focused on the implementation, extension, and use of test and performance tooling - both open source and commercial - targeting a broad spectrum of systems including embedded, stand-alone, distributed, and enterprise. There is particular interest in exploitation and user experience of the Test and Performance Tools Platform (TPTP) project. Presentation types include:
- Tutorial: A two hour presentation, with coding and/or a hands on workshop.
- Long Talk: A one hour presentation that goes into detail and/or demonstration on a topic.
- Short Talk: A five to ten minute presentation that covers the highlights of a topic.
- Posters: Posters are presented at the poster reception session.
- Birds of a Feather (BoF): BoF meetings are informal one-and-a-half-hour gatherings of people who want to talk about a particular topic.
- If you are interested in proposing a talk or tutorial, please:
- Important dates include:
- November 19, 2007: Submission deadline.
- December 10, 2007: Tutorials, Long Talks, and Short Talks selected.
- January 19, 2008: Submissions open for posters and BoFs.
- Reminder to participate in EclipseCon 2008 by proposing a talk or tutorial for the Test and Performance category. This category covers topics related to test and performance tooling that leverage Eclipse. Test and Performance tooling is used throughout the software development and test life cycle, from early unit testing, profiling, and tuning to post-deployment monitoring, tracing, and log analysis. This category is focused on the implementation, extension, and use of test and performance tooling - both open source and commercial - targeting a broad spectrum of systems including embedded, stand-alone, distributed, and enterprise. There is particular interest in exploitation and user experience of the Test and Performance Tools Platform (TPTP) project. Presentation types include:
Reminders
- Lead Committers:
- Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
- Add the Original Estimate (PH) when triaging a new defect.
- Update the Hours Worked (PH) when completing a defect.
- Test their components or review/track testing contributed by other committers/resources.
- Monitor the TPTP news group and answer posts specific to their Test Project components.
- Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
- Use the MyFoundation Portal for committer elections. The Portal adds more automation to the elections and makes the individual project elections more transparent to the entire Eclipse community. If you have been experiencing problems or have other issues with the Portal election process, please contact the EMO (emo@eclipse.org).
- All Committers:
- Monitor the TPTP news group and answer posts on topics other than the Test Project to support our user community.