TPTP-Test-Tools-20080505

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Tony Wang
  • Jerome Bozier

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• We have completed the I7 TP1.
  • The I7 candidate driver will be released later today.
• This week is I8 development (target: May 9).
  • All defects require Project approval (add a patch to the defect and set the review flag to paules@ca.ibm.com).

Testing

• Outstanding I7 TP1 test results:
  • Manual:
    • Tony:
      • /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite

News Group

• The following news group posts require a reply:
  • Duwayne:
    • Re: Using wait command in AGR script (March 11, 2008 2:07 PM)
    • Re: HTTP Recording stops immediately after start-up (FireFox) or never records data (IE) (March 25, 2008 1:15 PM)
    • tptp execuation task issue (April 2, 2008 3:12 PM)
    • Multi-Language tests with AGR (April 7, 2008 3:11 PM)
    • Testing an application with Custom component (April 8, 2008 11:03 AM)
    • Re: NoClassDefFoundError: org.eclipse.hyades.test.common...? (April 10, 2008 5:33 PM)
    • Re: Multiple instances for Verification Class (April 28, 2008 3:11 PM)
    • Re: Reusable Thread Error in standard mode (April 29, 2008 6:12 PM)

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defect against the Platform Project include:
    • Execution of any testsuite fails using the IAC - InactiveProcessException
  • Outstanding defect against the Test Project include:
    • Paul:
      • JUnit Plug-in runner incorrectly modifies deployed plugin.xml files.
      • AGR Tests require absolute path to Equinox JAR
      • Clear remote workspace launch does not work for remote test execution
      • AGR Tests cannot be run with start ACServer
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests
      • Content missing in Tabular Report
      • Connection property does not deploy all dependencies
      • Connection property does not allow JUnit Plug-in Tests to be executed
    • Duwayne:
      • ASF marshalling return value between service and client adapter does not have support for failures / exceptions
      • Confusing exceptions when running automated services.
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • Exceptions when running ASF tasks.
      • Only the name of the execution result is used from the results property.

Enhancements

• Queries.
• Schedule.

• Alexander Nyßen:
  • Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. AG/PMC approved and Contribution Questionnaire (CQ) approved. Paul will complete integration, testing, and check-in this week.

Defects

• Queries.

• Schedule.

• Defects require a sizing:
  • Jerome:
    • Test Navigator link to editor doesn't work when multiple editors open on file mapping to same proxy node.

• Defects to be deferred to Future:
  • See AG Call Minutes.

• Defects blocking the I7 TPs:
  • Paul:
    • Failures in /org.eclipse.hyades.test.ui.datapool.tests/junit/datapool/Test.UI.EncryptedDatapoolEditor_running.testsuite.: Resolved
    • datapool creation does not work properly if first row of CSV file contains variable name: Resolved
      • Cannot import valid CSV file into datapool.: Resolved
    • Context sensitive help requires refactoring and new content.: Requires the below defects. Deferred to I8
      • Technical review of Test Project documentation before 4.5 release.: Deferred to I8
      • Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.: Deferred to I8
      • Documentation smoke test failures.: Deferred to I8
  • Duwayne:
    • Parallel agent startup errors, InactiveProcessException: Deferred to I8
    • Random intermitten errors while launching a test against remote agents: Deferred to I8
    • Regression, URL Test Does Not Get Generated: Deferred to I8
    • SSL Recording not working, regression: Deferred to I8
    • Exception when canceling a recording (before "recording "actually starts): Deferred to I8
    • Cannot remove a test invocation to a removed HTTP request.: Patch is attached for one symptom (single test invocation), but solution for symptom with multiple test invocations is outstanding. Deferred to I8
  • Jerome:
    • Test Navigator link to editor doesn't work when multiple editors open on file mapping to same proxy node.: Deferred to I8
    • Refactoring error on attempt to Delete multiple Results from TN view.: Resolved
    • Deletion of Result from Test Navigator view fails.: Resolved
    • persisted proxy fail to load: Resolved
    • Unable to create proxy for testsuite: Deferred to I8
    • Impossible to copy/paste files from windows explorer to test navigator: Regression from Providing the ability to record user's interactions with GEF objects in a GEF editor. Resolved
  • Tony:
    • Accessibility-Need shortcuts for all Test Navigator pulldowns: Problems with shortcuts for on Test Navigator context menus. Deferred to I8

• Platform Project impacting the Test Project:
  • Execution of any testsuite fails using the IAC - InactiveProcessException: Bing cannot reproduce. Working with originator to determine if a configuration issue. Deferred to I8
  • Problem with AC on Linux: Resolved

• Defects required in I8:
  • Paul:
    • Regression, URL Test Does Not Get Generated
    • Starting Recording forces change to Test Perspective
    • Context sensitive help requires refactoring and new content.: Requires the below defects.
      • Technical review of Test Project documentation before 4.5 release.
      • Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.
      • Documentation smoke test failures.
    • Providing the ability to record user's interactions with GEF objects in a GEF editor
    • Review all plug-in dependencies.
    • Need new icon for testlog files
    • Creating resources with # in name is not prevented but causes problems loading the model
    • Test editor is too wide for users to read
    • (Usability) HTTP tests do not automatically generate JUnit Java code like JUnit tests.
    • Clean-up the TPTP committer lists and project matrix.
    • URL test type does not support encrypted datapools.
    • Junit plug-in test type does not support encrypted datapools.
    • TPTP EMF models needs to update
    • Provide ISV documentation for enhancement 166025.: Requires content from Jerome.
    • Resolving a boolean value from a datapool always returns false.
    • Generating a URL test class in the root Java package causes a compilation error.
    • 'asked for password' dialog still pop up when running the test after encrypt--then decrypt all variables in datapool (no encrypted data when running)
    • The challenge is not removed from the datapool when the last encrypted variable is removed
    • Test Tools about.properties files contain incorrect descriptions.
    • Deprecate JScrib and JScrib report generators.
    • testgen wizard does not preselect options
    • profiling trace generated from running a java app instrumented with api recording probe does not contain information
  • Duwayne:
    • SSL Recording not working, regression
    • Random intermitten errors while launching a test against remote agents
    • Parallel agent startup errors, InactiveProcessException
    • Exception when canceling a recording (before "recording "actually starts)
    • Cannot remove a test invocation to a removed HTTP request.: Patch is attached for one symptom (single test invocation), but solution for symptom with multiple test invocations is outstanding.
  • Jerome:
    • Test Navigator link to editor doesn't work when multiple editors open on file mapping to same proxy node.
    • Unable to create proxy for testsuite
  • Tony:
    • Accessibility-Need shortcuts for all Test Navigator pulldowns: Problems with shortcuts for on Test Navigator context menus.
  • Kit:
    • Incorrect german translation of the word "Pass"

• Defects deferred to I8 TP1/TP2:
  • Tony:
    • [Linux AGR test suite does not run.]
  • Duwayne:
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.
  • Jerome:
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.
  • Paul:
    • All external APIs should have JUnit tests
    • Automated Test Execution Harness Tests

Round-table

Paul

• Last Week:
  • Out of Office: 1/2 day
  • Resolved defects:
    • Failures in /org.eclipse.hyades.test.ui.datapool.tests/junit/datapool/Test.UI.EncryptedDatapoolEditor_running.testsuite.
    • URL test runner does not capture standard out and error.
    • ClassNotFoundException when running ASF automation services without OSGi/ICU.
    • Cannot import valid CSV file into datapool.
    • Removing an Artifact Location Pair returns a Null Pointer Exception
    • datapool creation does not work properly if first row of CSV file contains variable name
    • NoClassDefFound junit TestCase

• This Week:
  • See Defects section.

Duwayne

• Last Week:
  • 4.5 I7 TP1.
  • Out of Office: 1 day
  • Completed fix for SSL Recording not working, regression.
  • Worked on Random intermitten errors while launching a test against remote agents.
    • Hosted a call to discuss with the consuming product.

• This Week:
  • See Defects section.

Jerome

• Last Week:
  • Out of Office: 2 days
  • Resolved defects:
    • Impossible to copy/paste files from windows explorer to test navigator
    • persisted proxy fail to load
    • Refactoring error on attempt to Delete multiple Results from TN view.
    • Deletion of Result from Test Navigator view fails.

• This Week:
  • See Defects section.

Tony

• Last Week:
  • 4.5 I7 TP1.

• This Week:
  • Complete /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite.
  • See Defects section.

Action items

• None.

Notes

• None.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.