TPTP-Test-Tools-20080714

Attendees

• Present:
  • Paul Slauenwhite
  • Tony Wang

• Absent:
  • Jerome Bozier (vacation)

4.5.1

Release Information

• 4.5.1 will ship with the Ganymede Service Release 1 or SR1 (target release date: September 24, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• We have completed 2.5 weeks of development.

• We have 4.5 weeks of development remaining (target: August 12).

Defects

• Queries.

• Platform Project defects impacting the Test Project:
  • Major:
    • Execution of any testsuite fails using the IAC - InactiveProcessException

• Bugzillas (in order of completion):
  • Jerome:
    • Test Navigator deadlocks in UI thread: Fixed.
    • CoreExpcetion thrown when renaming a test that has just been pasted: Required by a consuming product. Requires a patch for 4.5.0. WORKSFORME.
    • Test asset depenencies not updated on save: Required by a consuming product. Requires a patch for 4.5.0. WORKSFORME (Duplicate of CoreExpcetion thrown when renaming a test that has just been pasted).
    • Refresh proxies for a re/opened project.: Required by a consuming product. Requires a patch for 4.5.0.
    • Unable to delete some projects in Test Perspective
    • 'Save as' option doesn't support test execution result
    • Duplicate execution time in .execution file in Test Perspective: Fixed.
    • Changing the file name of a test asset in the Test Navigator updates the logical name.
    • Rename error in Java perspective with test assets created in Test perspective: Fixed.
  • Paul:
    • Test Navigator does not support the Delete/Del key.: Required by a consuming product. Fixed.
    • Automated Test Execution Harness Tests
    • AGR test suites model disabled test invocations incorrectly.
    • IExecutionDeploymentAdapter.cleanUpTestAssets no longer called
    • Test Navigator action OpenReportAction is hardcoded, not defined in an extension
    • Test log viewer does not display extended properties.: WORKSFORME
    • Test Execution Tabular Report contains empty or incorrect child reports.
    • Provide ISV documentation for enhancement 166025.
    • When i try to open a TPTP Junit test result it gives me an error "Could not open the editor: An unexpected exception was thrown.": Fixed.
    • HTTP tests do not automatically generate JUnit Java code like JUnit tests.
    • Test Log Viewer does not show test suite/invocation hyperlinks after a test execution event is displayed.: Fixed.
    • WidgetFactory automatically scrolls to the right.
    • Cannot scroll to the bottom of the log file in log viewer events page
    • Can not debug launched eclipse process via ASF without rebuilding TPTP jar
    • Unable to associate multiple TestCases with an artifact: Fixed.
    • Test execution node in the events tree is missing a Defects pane: WONTFIX.
    • Create TPTP JUnit test suites for test model test classes.: Fixed.
    • Providing the ability to record user's interactions with GEF objects in a GEF editor
  • Tony:
    • Accessibility-Need shortcuts for all Test Navigator pulldowns: Required by a consuming product.
    • Test Log Viewer AGR test suites do not run.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.

4.5.2

Release Information

• 4.5.2 will ship with the Ganymede Service Release 2 or SR2 (target release date: February 25, 2009).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defects include:
    • Bing:
      • SAXParseException when opening hte IAC preference page.
    • Paul:
      • JUnit runner emits incorrect events when executing tests with behavior implemented as code.
      • Test Execution Tabular Report contains empty or incorrect child reports.: Duplicate of JUnit runner emits incorrect events when executing tests with behavior implemented as code.
      • JUnit and JUnit Plug-in test execution add incorrect elements to the plugin.xml file.
      • AGR Tests require absolute path to Equinox JAR
      • Clear remote workspace launch does not work for remote test execution
      • AGR Tests cannot be run with start ACServer
      • IExecutionDeploymentAdapter.cleanUpTestAssets no longer called
      • AbstractTestExecutionService – “Process was null -- test completed too fast?” message
      • Connection property does not deploy all dependencies
      • Test Execution fails when project defined incorrectly - ResourceException
      • Connection property does not allow JUnit Plug-in Tests to be executed
      • ASF marshalling return value between service and client adapter does not have support for failures / exceptions
      • Confusing exceptions when running automated services.
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • Exceptions when running ASF tasks.
      • Only the name of the execution result is used from the results property.

Round-table

Paul

• Last Week:
  • TPTP: 4 days
  • Diagnosing BVT issues with Joel.
  • Resolved defects:
    • Create TPTP JUnit test suites for test model test classes.
    • datapool_iterator and datapool_evaluator extension points do not resolve.
    • Test Log Viewer does not show test suite/invocation hyperlinks after a test execution event is displayed.
    • (Usability) Hyperlinks in Test Log view are rendered differently for the Test Execution event type.
    • Test log viewer: Verdict type Drop down menu on Events page toolbar doesn't display icons
    • (Usability) Test Log View show empty Verdict Summary when only the arbitrated verdict.
    • Test Log Viewer: Verdict navigation toolbar buttons do not enable/disable correctly.
    • (Accessibility) Test Log Viewer - Preserve 'Tab' movement.
    • (Usability) Verdict Summary BIRT chart in Test Log viewer displays 0%.
    • Test Navigator does not support the Delete/Del key.
    • Unable to associate multiple TestCases with an artifact
    • When i try to open a TPTP Junit test result it gives me an error "Could not open the editor: An unexpected exception was thrown."
    • URL Test - recorder & test generator to access HTTP protocol data directly in trace model instead of an auxiliary XML file
    • Generic Recorder Framework improvements.
    • Allow HTTP recording support for Client Side Digital Certificates
    • Test execution node in the events tree is missing a Defects pane
    • Reason property missing from Test Log viewer.
    • Test log viewer does not display extended properties.
    • Bidi3.2: (HCG) Unrecognized characters in Test Log Viewer

• This Week:
  • TPTP: 3 days
  • Defects.

Jerome

• Last Week:
  • Resolved defects:
    • Duplicate execution time in .execution file in Test Perspective
    • Rename error in Java perspective with test assets created in Test perspective
    • Test Navigator deadlocks in UI thread
    • Test asset depenencies not updated on save
    • CoreExpcetion thrown when renaming a test that has just been pasted

• This Week:
  • Vacation.

Tony

• Last Week:
  • Working on Accessibility-Need shortcuts for all Test Navigator pulldowns and Test Log Viewer AGR test suites do not run.

• This Week:
  • Action items.
  • Finish Accessibility-Need shortcuts for all Test Navigator pulldowns.

Action items

• Duwayne:
  • Verify/close your resolved defects.
  • Reply to the question in jdt.ui bundle activator assumes PlatformUI.getWorkbench(), causing autobuild failure when running headless.
  • Post the meeting minutes for the June 16, 23, 30 meetings.

• Jerome:
  • Verify/close your resolved defects.

• Tony:
  • Verify/close your resolved defects.

Notes

• In 4.5.1+, Paul will own all of the Test Project component due to recent resource changes.
  • Paul has been nominated on the TPTP mailing list as the Component Lead for the following components (see Update Bugzilla owners/components and the TPTP Project Matrix for Test Project committer changes.):
    • Duwayne --> Paul:
      • Test.Agents.Recorder
      • Test.Execution.AutoGUIRunner
      • Test.Execution.URLRunner
      • Test.UI.AutoGUIUI
      • Test.UI.URLTest
      • ASF.Runtime
      • Documentation (ASF)
    • Jerome --> Paul:
      • Test.UI
      • Test.UI.ConfigEditors
      • Test.UI.DatapoolEditor
      • Test.UI.FrameworkEditor
      • Test.UI.TestPerspective
  • The PMC will finalize the vote on this Wednesday's PMC call.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.