TPTP-Test-Tools-20080428

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Tony Wang
  • Jerome Bozier

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• This week is I7 TP2 (target: May 2).

Testing

• We need to complete I7 TP1 by EOD today using the candidate driver.
• For I7 TP2, Tony will continue running the smoke test suites for the resolved blocking defects.
  • • Paul, Jerome, and Duwayne will continue resolving the defects blocking the I7 TPs.

4.5 I7 TP1

• TP1 testing assignments:
  • Manual:
    • Tony:
      • /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite
      • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_225157.testsuite
      • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
    • Paul:
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite
    • Duwayne:
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Linux.testsuite
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.Execution.URLRunner.Remote.testsuite
  • JUnit:
    • Tony:
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.DatapoolPasswordServicesTest.testsuite
  • AGR:
    • Tony:
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM16_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun16_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM142_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM15_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun142_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun15_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.JUnitRunner.Bug186196.testsuite
      • /org.eclipse.hyades.test.ui.datapool.tests/gui/Test.UI.EncryptedDatapoolEditor.testsuite

News Group

• The following news group posts require a reply:
  • Duwayne:
    • Re: Using wait command in AGR script (March 11, 2008 2:07 PM)
    • Re: HTTP Recording stops immediately after start-up (FireFox) or never records data (IE) (March 25, 2008 1:15 PM)
    • tptp execuation task issue (April 2, 2008 3:12 PM)
    • Multi-Language tests with AGR (April 7, 2008 3:11 PM)
    • Testing an application with Custom component (April 8, 2008 11:03 AM)
    • Re: NoClassDefFoundError: org.eclipse.hyades.test.common...? (April 10, 2008 5:33 PM)

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defect against the Platform Project include:
    • Execution of any testsuite fails using the IAC - InactiveProcessException
  • Outstanding defect against the Test Project include:
    • Paul:
      • JUnit Plug-in runner incorrectly modifies deployed plugin.xml files.
      • AGR Tests require absolute path to Equinox JAR
      • Clear remote workspace launch does not work for remote test execution
      • AGR Tests cannot be run with start ACServer
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests
      • Content missing in Tabular Report
      • Connection property does not deploy all dependencies
      • Connection property does not allow JUnit Plug-in Tests to be executed
    • Duwayne:
      • ASF marshalling return value between service and client adapter does not have support for failures / exceptions
      • Confusing exceptions when running automated services.
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • ANT importExistingProjects throws Exception

Enhancements

• Queries.
• Schedule.

• Jerome:
  • Move, Copy, Delete, Rename and Import/Export test assets: Complete.

• Alexander Nyßen:
  • Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. AG/PMC approved and Contribution Questionnaire (CQ) approved. Deferred to I8 for integration and testing.

Defects

• Queries.

• Schedule.

• Defects blocking the I7 TPs:
  • Paul:
    • Failures in /org.eclipse.hyades.test.ui.datapool.tests/junit/datapool/Test.UI.EncryptedDatapoolEditor_running.testsuite.: Attempting to complete in I7.
    • datapool creation does not work properly if first row of CSV file contains variable name: Attempting to complete in I7.
      • Cannot import valid CSV file into datapool.: Attempting to complete in I7.
    • Context sensitive help requires refactoring and new content.: Requires the below defects. Attempting to complete in I7.
      • Technical review of Test Project documentation before 4.5 release.: Attempting to complete in I7.
      • Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.: Attempting to complete in I7.
      • Documentation smoke test failures.: Attempting to complete in I7.
  • Duwayne:
    • Parallel agent startup errors, InactiveProcessException: Attempting to complete in I7.
    • Random intermitten errors while launching a test against remote agents: Attempting to complete in I7.
    • Regression, URL Test Does Not Get Generated: Attempting to complete in I7.
    • SSL Recording not working, regression: Attempting to complete in I7.
    • Exception when canceling a recording (before "recording "actually starts): Attempting to complete in I7.
    • Cannot remove a test invocation to a removed HTTP request.: Patch is attached for one symptom (single test invocation), but solution for symptom with multiple test invocations is outstanding. Duwayne will attempt to complete in I7 but he needs more time to determine the root cause.
  • Jerome:
    • Test Navigator link to editor doesn't work when multiple editors open on file mapping to same proxy node.: Attempting to complete in I7.
    • Refactoring error on attempt to Delete multiple Results from TN view.: Attempting to complete in I7.
    • Deletion of Result from Test Navigator view fails.: Attempting to complete in I7.
    • persisted proxy fail to load: Attempting to complete in I7.
    • Unable to create proxy for testsuite: Attempting to complete in I7.
    • Impossible to copy/paste files from windows explorer to test navigator: Regression from Providing the ability to record user's interactions with GEF objects in a GEF editor. Attempting to complete in I7.
  • Tony:
    • Accessibility-Need shortcuts for all Test Navigator pulldowns: Problems with shortcuts for on Test Navigator context menus. Deferring to I8.

• Platform Project impacting the Test Project:
  • Execution of any testsuite fails using the IAC - InactiveProcessException: Bing cannot reproduce. Working with originator to determine if a configuration issue.
  • Problem with AC on Linux: Jonathan is investigating.

• Defects required in I8:
  • Paul:
    • Review all plug-in dependencies.
    • Need new icon for testlog files
    • Creating resources with # in name is not prevented but causes problems loading the model
    • Test editor is too wide for users to read
    • (Usability) HTTP tests do not automatically generate JUnit Java code like JUnit tests.
    • Clean-up the TPTP committer lists and project matrix.
    • URL test type does not support encrypted datapools.
    • Junit plug-in test type does not support encrypted datapools.
    • TPTP EMF models needs to update
    • Provide ISV documentation for enhancement 166025.
  • Jerome:
    • Open test editors are not refreshed when removing referenced test assets.
    • Changing the file name of a test asset in the Test Navigator updates the logical name.

Round-table

Paul

• Last Week:
  • 4.5 I7 TP1.
  • Resolved defects:
    • Exception in the deployment editor when a referenced artifact is deleted.
    • NPE inTestsuiteLocationWizardPage constructor if no wizard is given
    • [ASF FileNotFoundException when interrogating test execution results.]
    • Can not run junit test using String and Double encrypted datapool data
    • Test Tools about.properties files contain incorrect descriptions.
    • NullPointerException constructing navigator proxies: DefaultTestSuiteProxyNode.addInvocationReferences
    • BIDI3.4:Spaces are truncated in code update preview
    • HTML Test Report Generation fails - MalformedURLException: unknown protocol: d
    • ClassNotFoundException when running ASF automation services without OSGi/ICU.
    • Running a test linked to a datapool cause Severe Error
    • The invocation for some deleted testcases can't be removed in behaviour tab

• This Week:
  • See Defects section.

Duwayne

• Last Week:
  • 4.5 I7 TP1.
  • Working on Cannot remove a test invocation to a removed HTTP request.: Model code defect.
• Assisting consuming products resolving issues found during integrating with TPTP M5.

• This Week:
  • Out of Office: 1 day
  • See Defects section.

Jerome

• Last Week:
  • Vacation: 4 days
  • Resolved defects:
    • Filename vs. logical name in UI
    • Test assets' editors (locations, datapools etc) allow save with empty internal names
    • Adding a location or artifact with a duplicate name of a removed resource in a deployment does not work
    • Move, Copy, Delete, Rename and Import/Export test assets.

• This Week:
  • Out of Office: 2 days
  • See Defects section.

Tony

• Last Week:
  • 4.5 I7 TP1:

• This Week:
  • Complete 4.5 I7 TP1.
  • 4.5 I7 TP2:
  • Complete defect Accessibility-Need shortcuts for all Test Navigator pulldowns.

Action items

• None.

Notes

• None.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.