Remaining reporting inconsistencies (see 187864) have been resolved and the correct test reports (4.4.0.1, 4.4.0.2, 4.4.0.3, and 4.4.1) have been posted.
4.4.1
4.4.1 will ship with the Europa Winter Maintenance Release (target release date: February 29, 2008).
Release Engineering has split CVS streams (4.4.1 and 4.5 (HEAD)). Any fixes checked-in to the 4.4.1 stream MUST be checked-in to HEAD.
Outstanding defect(s):
168597([Vista] HTTP Recorder requires work-around on Windows Vista) for inclusion in the new 4.4.1 deliverable. A summary of the issues and fix is at 168597. Joe and Paul will review the patches today/tomorrow and provide comments. Duwayne will request project approval (requires a Stop Ship Template) and update the final hours worked.
After a review of the API report for 4.4.1, the following class was added:
As discussed at the TPTP F-2-F, we are considering the following due to resource constraints:
Isolating and moving the following function to Technology Preview:
Manual Test
Deprecating or not moving forward the following function:
API Recorder
AGR
The following AG-approved enhancements will requested for PG/PMC approval:
202695 Encrypted datapool variable support: Will be completed by a non-committer from IBM (Xin Ying Huang).
162605 Test execution should support parallel execution of tests: Will be completed by Duwayne and/or Joe.
166025 Move, Copy, Delete, Rename and Import/Export test assets.: Jerome G. will schedule a public call this week to revisit this topic, design, and implementation to transition to Jerome B. and review for others.
145146 Generic Recorder Framework improvements.: Will be completed by Paul.
Current defects:
107432 (Test) IPv6 support in URL Test HTTP Recorder (required by Platform enhancement 165409): Duwayne will contact an IBM Test Team to schedule time on an internal IPv6 network for testing this week.
199237 (Test) [Java 6] Test execution stalls at 36%. (required by Platform enhancement 200535): Duwayne will investigate.
200194 ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results.: Duwayne will investigate.
123650 [Usability] HTTP tests do not automatically generate JUnit Java code like JUnit tests.: Duwayne will investigate.
171083 AGR Recorder does not distinguish between two controls on the same panel if they have the same text and type: Paul is investigating.
187864 Skewed completion rates in BIRT test reports.: Paul is finishing the implementation.
206355 [Usability] Switch to Test Perspective after test execution.: Paul is investigating.
206356 [Usability] Switch to Test Perspective after creating a test asset.: Paul is investigating.
170651: Will be completed by Jerome B. early in 4.5. Work-around required until 171083 is resolved.
170653: Will be completed by Jerome B. early in 4.5. Paul has provided some AGR test suites created from the Test Navigator manual test suites for review. Once reviewed, please check them into CVS (HEAD), remove the manual test suites that they cover from the behavior AllManualTests.testsuite (and AllManualSmokeTests.testsuite), and add the new AGR tests to the behavior of AllGUITests.testsuite (and AllGUISmokeTests.testsuite).
144950 [Scalability] Address TPTP EMF model scalability problems: Although withdrawn as a 4.5 candidate enhancement, the outcome/status of the work done in 4.4 on this enhancement was not updated in the WIKI page. Joe will update the WIKI this week.
Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure including:
Committers responsible for automating their manual tests.
Defining a common process and automation framework
Running the automated tests on the automation framework
Integrate the automation framework with the build framework (BVT).
Duwayne has concerns with the stability of the AGR (e.g. Linux) in that the AGR is good tool but there remain several usability and stability issues. Although there are limitations with the AGR, we have a significant number of existing AGR test suites and it is one of the better open-source automated functional UI testing tools. We will continue using the AGR in 4.5 and dedicate resources to resolve usability and stability issues as they arise.
Paul and the Release Engineering Team (Joel) are working on integrating EMMA with our build process (generating statically instrumented 'EMMA' drivers for testing with code coverage enabled), which we will use in the 4.4.1/4.5 test passes.
Test project topics for upcoming AG calls include:
Enhancement 166025 (Move, Copy, Delete, Rename and Import/Export test assets) as it relates to the other EMF models in TPTP.
The effort by the Release Engineering Team on consolidating our testing process and automation infrastructure.
The effort by the Release Engineering Team on integrating EMMA with our build process.
The PMC has asked that each project prepare weekly milestones for both 4.4.1 and 4.5 releases. As such, we need to resume (starting next week) our weekly status updates and 'to-dos' of defects including defects, blocking issues, and architectural issues/concerns that we will focus on completing the upcoming week. This will assist in keeping our enhancement work and defect backlog front and center, encourage peer review, tack status and identify/communicate any blocking issues. Please prepare to discuss your upcoming week's goals on the next Test Project call.
Action items
All committers to prepare to discuss their past week's status and upcoming week's goals.
Reminder to participate in EclipseCon 2008 by proposing a talk or tutorial for the Test and Performance category. This category covers topics related to test and performance tooling that leverage Eclipse. Test and Performance tooling is used throughout the software development and test life cycle, from early unit testing, profiling, and tuning to post-deployment monitoring, tracing, and log analysis. This category is focused on the implementation, extension, and use of test and performance tooling - both open source and commercial - targeting a broad spectrum of systems including embedded, stand-alone, distributed, and enterprise. There is particular interest in exploitation and user experience of the Test and Performance Tools Platform (TPTP) project. Presentation types include:
Tutorial: A two hour presentation, with coding and/or a hands on workshop.
Long Talk: A one hour presentation that goes into detail and/or demonstration on a topic.
Short Talk: A five to ten minute presentation that covers the highlights of a topic.
Posters: Posters are presented at the poster reception session.
Birds of a Feather (BoF): BoF meetings are informal one-and-a-half-hour gatherings of people who want to talk about a particular topic.
If you are interested in proposing a talk or tutorial, please:
December 10, 2007: Tutorials, Long Talks, and Short Talks selected.
January 19, 2008: Submissions open for posters and BoFs.
Reminders
Lead Committers:
Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
Add the Original Estimate (PH) when triaging a new defect.
Update the Hours Worked (PH) when completing a defect.
Test their components or review/track testing contributed by other committers/resources.
Monitor the TPTP news group and answer posts specific to their Test Project components.
Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
Use the MyFoundation Portal for committer elections. The Portal adds more automation to the elections and makes the individual project elections more transparent to the entire Eclipse community. If you have been experiencing problems or have other issues with the Portal election process, please contact the EMO (emo@eclipse.org).
All Committers:
Monitor the TPTP news group and answer posts on topics other than the Test Project to support our user community.
