TPTP-Test-Tools-20080811

Attendees

• Present:
  • Paul Slauenwhite
  • Tony Wang
  • Jerome Bozier

4.5.1

Release Information

• 4.5.1 will ship with the Ganymede Service Release 1 or SR1 (target release date: September 24, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• We will complete 4.5.1 early to support our consumers and to eliminate the need for a 4.5.0.1 maintenance release:
  • We completed 4.5.1 development on Friday (July 25).
  • We completed 4.5.1 TP1 on Friday (August 8).
  • There are several 4.5.1 defects remaining that will be completed today.
    • After they are complete, only new functional defects resulting from testing on the new Ganymede RC1 milestone drivers will be considered for 4.5.1.
  • There are several 4.5.1 defects to be deferred from 4.5.1 to 4.5.2 and 4.5.3.

Defects

• Queries.

• Platform Project defects impacting the Test Project:
  • Major:
    • Execution of any testsuite fails using the IAC - InactiveProcessException: Requested to be deferred to 4.5.2.

• Bugzillas (in order of completion):
  • Paul:
    • NullPointerException in TestsuiteLocationWizardPage.java:65: Tested/reviewed patch attached to defect. PMC approved and checked in to CVS (HEAD).
    • (Test Automation) Automated Test Execution Harness Tests: Test automation defect to be completed in 4.5.1.
    • Provide ISV documentation for enhancement 166025.: Requested to be deferred to 4.5.2.
    • Bidi3.2: (HCG) Stack trace messages should be customly ordered: Requested to be deferred to 4.5.2.
  • Tony:
    • Test Log Viewer AGR test suites do not run.: Test automation defect to be completed in 4.5.1.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation defect to be completed in 4.5.1.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation defect to be completed in 4.5.1.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation defect to be completed in 4.5.1.

4.5.2

Release Information

• 4.5.2 will ship with the Ganymede Service Release 2 or SR2 (target release date: February 25, 2009).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Defects

• Queries.

• Defects requiring a sizing:
  • Jerome:
    • Some contents are missing when creating/deleting/renaming deployment pairs
    • Renaming folders by changing letter case is inconsistent, causes problems
    • Test Navigator needs to notify before starting and after completing refresh job
    • Deleting a test case in the Test Navigator will delete the test suite.

• Bugzillas:
  • Jerome:
    • Deleting a test case in the Test Navigator will delete the test suite.
    • Some contents are missing when creating/deleting/renaming deployment pairs
    • Periodic NullPointerException when creating proxies.
    • Renaming folders by changing letter case is inconsistent, causes problems
    • Changing the file name of a test asset in the Test Navigator updates the logical name.
    • Can't delete Plugin-project completely some times in Test perspective
    • Test Navigator needs to notify before starting and after completing refresh job
  • Paul:
    • JUnit runner emits incorrect events when executing tests with behavior implemented as code.
    • Test Log Viewer: Overview page layout problems
    • IExecutionDeploymentAdapter.cleanUpTestAssets no longer called
    • Cannot scroll to the bottom of the log file in log viewer events page
    • Datapool variables are not encrypted without the MD5 hash algorithm.
    • IWAT4039E NullPointerException - randomnly while headless junit execution
    • HTTP tests do not automatically generate JUnit Java code like JUnit tests.
    • WidgetFactory automatically scrolls to the right.
    • Can not debug launched eclipse process via ASF without rebuilding TPTP jar
    • Temporary files are not removed from the user's temporary directory.
    • The dirty bit is not being set in the datapool editor after delete some equivalence classes
    • Copy and paste in encrypted datapool
    • Cannot paste plain text in a datapool cell.
    • Providing the ability to record user's interactions with GEF objects in a GEF editor

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defects include:
    • Paul:
      • IExecutionDeploymentAdapter.cleanUpTestAssets no longer called
      • Connection property does not deploy all dependencies and execute JUnit Plug-in Tests correctly.
      • IWAT4039E NullPointerException - randomnly while headless junit execution
      • JUnit runner emits incorrect events when executing tests with behavior implemented as code.
      • JUnit and JUnit Plug-in test execution add incorrect elements to the plugin.xml file.
      • AGR Tests require absolute path to Equinox JAR
      • Clear remote workspace launch does not work for remote test execution
      • AGR Tests cannot be run with start ACServer
      • AbstractTestExecutionService – “Process was null -- test completed too fast?” message
      • Test Execution fails when project defined incorrectly - ResourceException
      • ASF marshalling return value between service and client adapter does not have support for failures / exceptions
      • Confusing exceptions when running automated services.
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • Exceptions when running ASF tasks.

Round-table

Paul

• Last Week:
  • Out of office: 2 days
  • TPTP: 1.5 days
  • Ad-hoc 4.5.1 testing.
  • Resolved defects:
    • Several copy/paste/cut problems in datapool editors
    • (Web) (Readme) Cannot paste plain text in a datapool cell.

• This Week:
  • TPTP: 2.5 days
  • Action items.
  • Defects.

Jerome

• Last Week:
  • TPTP: 2.5 days
  • Working on Can't delete Plugin-project completely some times in Test perspective.

• This Week:
  • TPTP: 2.5 days
  • Action items.
  • Defects.

Tony

• Last Week:
  • TPTP: 4 days
  • 4.5.1 TP1.

• This Week:
  • TPTP: 5 days
  • Finish 4.5.1 TP1.
  • Action items.
  • Defects:
    • Finish Test Log Viewer AGR test suites do not run.

Action items

• Duwayne:
  • Reply to the question in jdt.ui bundle activator assumes PlatformUI.getWorkbench(), causing autobuild failure when running headless.
  • Post the meeting minutes for the June 16, 23, 30 meetings.

• Jerome:
  • Verify/close your resolved defects.

• Tony:
  • Verify/close your resolved defects.

• Paul:
  • Verify/close your resolved defects.

Notes

• This is the last Test Project weekly call.
  • In place, we will merge with the Platform Project weekly call on Thursdays at 9 - 10 AM ET.
  • Joanna will send calendar invitations to Tony, Jerome, and Paul with the call-in information.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.