Difference between revisions of "TPTP-Test-Tools-20080428"

Revision as of 09:49, 28 April 2008

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Tony Wang
  • Jerome Bozier

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• This week is I7 TP2 (target: April 25).

Testing

• We need to complete I7 TP1 by EOD today using the candidate driver.
• For I7 TP2, Tony will continue running the smoke test suites for the resolved blocking defects.
  • • Paul, Jerome, and Duwayne will continue resolving the defects blocking the I7 TPs.

4.5 I7 TP1

• TP1 testing assignments:
  • Manual:
    • Tony:
      • /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite
      • /org.eclipse.hyades.test.ui.navigator.tests/manual/Test.UI.TestNavigator_bugzilla_225157.testsuite
      • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.EncryptedDatapool_editing.testsuite
    • Paul:
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite
    • Duwayne:
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Linux.testsuite
      • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.Execution.URLRunner.Remote.testsuite
  • JUnit:
    • Tony:
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.DatapoolPasswordServicesTest.testsuite
  • AGR:
    • Tony:
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM16_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun16_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM142_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM15_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun142_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun15_JUnitRunner.testsuite
      • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.JUnitRunner.Bug186196.testsuite
      • /org.eclipse.hyades.test.ui.datapool.tests/gui/Test.UI.EncryptedDatapoolEditor.testsuite

News Group

• The following news group posts require a reply:
  • Duwayne:
    • Re: Using wait command in AGR script (March 11, 2008 2:07 PM)
    • Re: HTTP Recording stops immediately after start-up (FireFox) or never records data (IE) (March 25, 2008 1:15 PM)
    • tptp execuation task issue (April 2, 2008 3:12 PM)
    • Multi-Language tests with AGR (April 7, 2008 3:11 PM)
    • Testing an application with Custom component (April 8, 2008 11:03 AM)
    • Re: NoClassDefFoundError: org.eclipse.hyades.test.common...? (April 10, 2008 5:33 PM)

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defect against the Platform Project include:
    • Execution of any testsuite fails using the IAC - InactiveProcessException
  • Outstanding defect against the Test Project include:
    • Paul:
      • AGR Tests require absolute path to Equinox JAR
      • Clear remote workspace launch does not work for remote test execution
      • AGR Tests cannot be run with start ACServer
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests
      • Content missing in Tabular Report
      • Connection property does not deploy all dependencies
      • Connection property does not allow JUnit Plug-in Tests to be executed
    • Duwayne:
      • ASF marshalling return value between service and client adapter does not have support for failures / exceptions
      • Confusing exceptions when running automated services.
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • ANT importExistingProjects throws Exception

Enhancements

• Queries.
• Schedule.

• Jerome:
  • Move, Copy, Delete, Rename and Import/Export test assets: Complete.

• Alexander Nyßen:
  • Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. AG/PMC approved and Contribution Questionnaire (CQ) approved. Deferred to I8 for integration and testing.

Defects

• Queries.

• Schedule.

• Defects blocking the I7 TPs:
  • Paul:
    • [https://bugs.eclipse.org/bugs/show_bug.cgi?id=228227 Failures in

/org.eclipse.hyades.test.ui.datapool.tests/junit/datapool/Test.UI.EncryptedDatapoolEditor_running.testsuite.]: Working on this week.

• • • datapool creation does not work properly if first row of CSV file contains variable name: Paul is working on a fix for today/tomorrow.
    • Context sensitive help requires refactoring and new content.: Requires the below defects. Deferring to I8.
      • Technical review of Test Project documentation before 4.5 release.: Working on this week.
      • Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.: Working on this week.
      • Documentation smoke test failures.: Working on this week.
    • ClassNotFoundException when running ASF automation services without OSGi/ICU.: Patch reviewed/approved. Waiting for PMC approval.
  • Duwayne:
    • Exception when canceling a recording (before "recording "actually starts): Duwayne is working on the fix for Friday.
    • Cannot remove a test invocation to a removed HTTP request.: Duwayne has a patch and is testing. Once tested/reviewed/approved, Duwayne will integrate by Friday.
  • Jerome:
    • Unable to create proxy for testsuite
    • Impossible to copy/paste files from windows explorer to test navigator: Jerome cannot reproduce this behavior. Returned as WORKSFORME.
  • Tony:
    • Accessibility-Need shortcuts for all Test Navigator pulldowns: Problems with shortcuts for on Test Navigator context menus. Deferring to I8.

• Platform Project impacting the Test Project:
  • Execution of any testsuite fails using the IAC - InactiveProcessException: Bing cannot reproduce. Working with originator to determine if a configuration issue.

• Defects required in I8:
  • Paul:
    • (Usability) HTTP tests do not automatically generate JUnit Java code like JUnit tests.

Round-table

Paul

• Last Week:
  • Resolved defects:
    • Regression - Firefox recording error
    • NLS34 - Found 2 consecutive single quotes in text not handled by Java MessageFormat class
    • Garbage output in recorder log when non-translated strings are sent by the agent
    • (Web) (Linux) Cannot not delete test assets in the Test Navigator.
    • (Web) Test execution periodically hangs.
    • (Web) (Vista) Test execution terminates abnormally.
    • doc updates for section Creating a test deployment
    • what does the synchronous option mean for an invocation behavior in a JUnit Test Suite?
    • Time Frame Historical Report view does not have tabs and is missing info
    • Test Tools documentation I5/I6 smoke test failures.
    • UI allows to launch non-profilable tests in profile mode
    • Time out error message during test execution is not resolving.
    • InactiveProcessException when launching AGR tests using the Agent Controller.
    • Time-out Threshold always set to default of 30000
    • InactiveProcessException when launching JUnit Plug-in tests using the Agent Controller.
    • Vista-specific error dialog when recording using IAC/IE on XP.
    • Can not load datapool file while running a Juint test
    • Create TVT/enablement test cases for new Test Project UI.
    • Can not cancel changes while closing datapool editor
    • Test editors: links to test elements don't do highlighting anymore
    • Test Log Viewer: Link to deployment is displayed when using temp deploy not named 'default'
    • variables are listed twice in the "EquivalenceClass" pane of Datapool
    • Test Tools about.properties files contain incorrect descriptions.
    • (Test Navigator) Resource Information is not available for package and source folder nodes
    • "Paste" doesn't not complete normally
    • NullPointerException when deleting artifact location pairs.
    • Encrypted datapool variable support
    • Unmovable rows in Datapool Editor
    • No help for datapool/TPTP wizard.
    • The 'Encrypt' option doesn't work with keyboard selection
    • Usability - adding existing artifacts/locations to deployment should select by name (not filename)
    • scroll bars not appearing when needed in test suite editor and other Hyades editors when content doesn't all fit in a page
    • creating TPTP test but you need to have parent project created first.
    • No test report generators appear in the New Report dialog.
    • Report Icon is incorrect for Test Pass and Time Frame Historic
    • Test Report reports the last test execution only
    • Generate Report: Test Navigator does not refresh to show new report
    • TVT:PRT70_CHT_Duplicate mnemonics
    • (Usability) Missing/inconsistent titles/descriptions/icons in test report dialogs.
    • Unable to load file /Test/ejb2.testsuite during test generation
    • System default browser is not used as the default browser for URL recording.
    • Recorder Control view is not opened or has focus when a recording is started

• This Week:
  • 4.5 I7 TP1.
  • Defects:
    • Running a test linked to a datapool cause Severe Error
    • HTML Test Report Generation fails - MalformedURLException: unknown protocol: d
    • Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.
    • Technical review of Test Project documentation before 4.5 release

Duwayne

• Last Week:
  • Integrated community patches for:
    • Difficulties recording a session in Linux: the order/reporting of SWT events on Linux seems to be different than in Windows.
    • Certain characters in text on Button causes recorded script not playable
    • Continuous single selection in List/Table/Tree cannot be recorded correctly
    • Redundant dependency on org.eclipse.ui.testing
    • Redundant message to STDOUT when execute in quick mode
  • Resolved defect:
    • Command Line Execution - overwrite = True flag does not actually overwrite the results: Resolved (WORKSFORME).
  • Worked on defect Cannot remove a test invocation to a removed HTTP request.
  • Product testing of TPTP M5.

• This Week:
  • 4.5 I7 TP1.
  • Defects:
    • Exception when canceling a recording (before "recording "actually starts)
    • Cannot remove a test invocation to a removed HTTP request.
    • The invocation for some deleted testcases can't be removed in behaviour tab

Jerome

• Last Week:
  • Vacation: 2 days
  • Continued working on enhancement Move, Copy, Delete, Rename and Import/Export test assets.

• This Week:
  • Vacation: 4 days
  • Defect:
    • Unable to create proxy for testsuite
  • Close on enhancement Move, Copy, Delete, Rename and Import/Export test assets.

Tony

• Last Week:
  • Continued working on defect Accessibility-Need shortcuts for all Test Navigator pulldowns.

• This Week:
  • 4.5 I7 TP1:
  • Test with P2 Equinox.

Action items

• None.

Notes

• None.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.